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ABSTRACT 

A comparison of the effectiveness of different ways 
to organize instructional materials and different strategies for 
error feedback used the computer as a research tool and took as 
subjects first-year junior high school Spanish students, who were 
randomly assigned to experimental and control groups. To investigate 
materials organization, computer exercises were designed in Spanish 
to measure the effect on achievement of such factors as integrated 
context vs. discrete items, personally meaningful material vs« 
impersonal material, student choice of background content vs. program 
choice, and the effect of problem-solving activities on the 
acquisition of language skills. To compare error feedback methods, 
the study considered the relative effectiveness of student-controlled 
help vs. program-controlled error correction, types of error 
repetition, and the role of student discovery in the error correction 
process. Post achievement test gain scores were consistently in favor 
of the experimental group. The findings and their implications for 
instructional materials design, computer-assisted instruction, and 
testing are discussed. Appendixes include questionnaires, materials 
descriptions, sample achievement tests, student interest 
questionnaire, transcript of taped interviews, and programming 
strategies , (Author/MSE) 
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COMPUTER-ASSISTED-INSTRUCTION IN FOREIGN LANGUAGE EDUCATION 
a comparison of the effectiveness of different diethodologies 
and different forms of error correction 



ABSTRACT 



This study was funded by a major grant from the Interna- 
tional Research and Studies Division, U.S. Department of 
Education, contract number G008402275, and was completed 
during the 1984-85 academic year. The field study was conduct- 
ed with first-year Spanish students at Montera Junior High 
School, Oakland, California in the spring of 1985. In this 
project, the computer was used as a research tool with which 
to compare the effectiveness of 1) different ways of organiz- 
ing instructional material, and 2) different strategies for 
error feedback. For the former, computer exercises in Spanish 
were designed to measure the effect on achievement of such 
factors as integrated context vs. dfscrete items, personally 
meaningful vs. impersonal material, student choice of 
background content vs. program choice, and the effect of 
problem-solving activities on the acquisition of language 
skills. For the comparison of error feedback, the study 
considered the relative effectiveness of student-controlled 
help vs. program-controlled error correction, types of error 
repetition, and the role of student discovery in the error 
correction process, (eg. location of error vs. commentary as 
in hints, implicit vs. explicit feedback). The experimental 
group significantly outperformed the control group on the 
cumulative post achievement test gain scores. These scores are 
consistently in favor of the experimental group in absolute 
terms and when scores were mediated by prior knowledge, 
aptitude, attitudes and abilities, giving strong evidence in 
favor of the experimental hypotheses and their treatments. 
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EABl-QNEi._PURPOSE.OP.THE^RESEAR 

1 THE ROLE OP COMPUTER- ASSISTED INSTRUCTION <CAI> IN FOREIGN 
LANGUAGE EDUCATION: STATE OF THE ART 

I A The computer revolution 

The use of computers In the nation's schools Is growing at a 
rapid rate, yet It Is not without Its problems* In a manner that 
recalls the recent history of the language lab, we find that the 
development of hardware— the machines themselves— -far outstrips 
the production of quality software or -courseware" — the programs 
needed to enable the computers to "teach"* Much courseware are 
actually "electronic workbooks": text-like dr 111-and-pract Ice 
activities that are actually little more than an expensive way to 
present a text, at considerable cost to the educational consumer 
can scarcely Justify the considerable investment involved* 

At this early stage lik the use of computers In language 
teaching, educators have an opportunity to take a long, hard 
look at what Is happening and help determine the direction It 
will take* If the capabilities offered by this new medium are 
applied In accordance with sound pedagogical principles, much 
good can be accomplished; If used In a hurried and unthinking 
fashion^ much harm can be done: 

"It Is Imperative that computers enter our 
educational system In an orderly. Intelligent 
manner. In contrast to our experience with 
television- (Braun 1980) 

1*2 State of the research 

It is probably much too early to expect any definitive 
findings on the effectiveness of CAI materials* To date, few 
studies have been carried out, and the little research which Is 
available Is conflicting* Braun <1980> claims that student 
attrition is decreased, and that performance on certain exams Is 
Improved and/or learning time Is saved when Instruction Is 
supplemented with CAI. Hawkins (1970), In a study which 
antedates the microcomputer revolution, claims that CAI has no 
consistent positive or negative effects on student achievement or 
attrition* Edwards, et al . (1975) have shown that CAI Is no more 
and no less effective compared with other nontradl t lonal methods 
of Instruction, e*g* tutoring, language lab, and fllmstrlps. 
Frenzel <1980> states that CAI "has never demonstrated any 
superiority over other teaching techniques." 

The conflicting results may be due In part to the nature of 
the questions asked* In setting out to compare the effectiveness 
of CAI and classroom Instruction, they have failed to consider 

1 
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Text Instructions: Make a sentence in Spanish in which you: 
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1. Ask a classmate if he or she likes gifts^ 

2. Say that the class is interesting* 

3» Tell two of your friends that they are interesting* 

( ibid.) 

None of the above exercises would be considered authentic speech 
from a native speaker^s point of view. "People simply do not 
communicate in disconnected sentences or words. We read material 
on a particular topic. We hear speech within a particular 
context, if only for the duration of a sentence or two. And, 
with the notable exception of some foreign language classes, we 
write things pertaining to a particular context* (Robinson, 
1985, p. 36). 

Even when the emphasis is on linguistic competence through 
the learning of particular forms or discrete lexical items, 
research has shown that memory for discrete items is also 
improved by providing an Integrated context (ibid., p. 37). For 
example. Bower and Clark (1969) presented two groups of subjects 
with lists of ten totally? unrelated nouns which they were told to 
memorize* The experimental group was instructed to learn the 
words in each list by creating a sentence or small story which 
contained all the words in a single context, however forced^ The 
following is an example of one subject's response (the key words 
to be learned are given in upper case): 

-A VEGETABLE can be a useful INSTRUMENT for a COLLEGE 
student. A carrot can be a NAIL for your FENCE, or 
BASIN. But a MERCHANT of the QUEEN would SCALE that 
fence and feed the carrot to a GOAT.** (Bower and Clark, 
1969) . 

The control group was simply told to memorize the list of 
words. On a delayed recall test, -Subjects who had made up 
stories were able to recall correctly 94% of the words from all 
the lists, as compared with only 14% for the control subjects* 
(ibid.). The student-generated integrated context clearly 
Improved recall of semantically discrete items^ 

The examples throughout this section suggest the hypothesis 
that items presented within an integrated and meaningful context 
will be remembered over time and learned more efficiently than 
those presented discretely. In the present study, this hypothesis 
is examined in two different ways: (1) comparing material which 
is presented in an integrated context with material presented in 
unrelated sentences, and (2) comparing practice based on compre- 
hension of the sentences with practice in manipulating the form 
(see Appendix B, Day 4 and Day 7, respectively). 

^ 8-9 
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2 THEORETICAL FRAMEWORK: ACQUISITION VS. LEARNING, COMMUNI- 
CATIVE COMPETENCE AND FUNCTIONAL/NOTIONAL APPROACHES TO 
SECOND LANGUAGE LEARNING 

One of the major trends In pedagogy reflected in second 
language literature during the past decade has been the shift 
from emphas i s on the structure and form of language to the 
meaning conveyed through It (e.g. Krashen, 1979, Rivers 1972, 
Robinson 1978, 1981, Savlgnon 1972, Stevick 1976, Wilklns 1976). 
This distinction between form-centered practice and meaning-cen- 
tered practice through authentic communication has been interpre- 
ted through a variety of somewhat overlapping theoretical 
frameworks, referred to variously as the distinction between 
1 1 ngu ist ic vs . commun Ica 1 1 ve competence , learning vs . acquis i- 
t ion and grammatical vs. not ional /functional syllabuses: 

••Linguist Ic competence is primarily manifested in the 
ability to produce grammatically acceptable <i.e. 
"correct") sentences. The concept of communicative 

competence is far less clear cut... Within the United 
States at least, the recent concern with communicative 
competence stems largely from sociol ingu ists who feel 
that a truly interesting study of language must include 
its functions in communicative context and the rules 
which determine social acceptability and appropriateness 
<e.g. Dell Hymes 1972)... From the pragmatic point of 
view, communicative competence Is... viewed primarily as 
the ability to perform speech acts in such a way that 
they accomplish the outcomes intended by the speaker. 
Closely related to both the soc lol Ingu I st ic and 
pragmatic v lews of commun ica^;ive competence Is the one 
rooted in the notional analysis of language (e.g. Mumby 
1978): Communicative abllP;y Is viewed essentially as 
an ability to express formally notional categories 
required In specific communicative contexts. - 
CPolitser 1982). 

Wh i le approaches which f ocus on commun I cat ive competence , 
language acquisition, and funct lonal /not lonal syllabuses differ 
on many levels, they share a <jommon emphasis on meaning as 
opposed to form. 

2.1 Problems with CAT In FL education in relation to this 
framework 

As mentioned in section 1.2, there is some fear that CAI In 
foreign languages will -turn the clock back** to an earlier, more 
traditional era in language education. This fear may be partly 
due to the mistaken assumptloji that the computer Is by Its very 
. \re predisposed to empw.oisis on form rather than emphasis on 
meaning. In actuality, the computer itself has no intrinsic 
pedagogical or lentat ion, s ince this depends ent Irely on the 
program one puts Into It. Thus CAI activities could just as 
well focus on meaning rather than form; activities could well be 
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organized around a notional approach rather than a grammatical 
approach; activities could be -acquisition" oriented rather than 
"learning- oriented (in Krashen's sense)* It is possible that 
the goals of communicative competence might be facilitated 
through content which was culturally authentic as well as 
personally meaningful, and exercises in which dialogues branched 
according to the student's (speaker's) intention, as reflected in 
his/her choice of response. The challenge to foreign language 
educators lies in the creation of exercises which fit within the 
most promising theoretical frameworks, as evidenced by research. 
Perhaps our efforts in this regard have been weakened by the 
unthinking perpetuation of drills organized around the elements 
we have traditionally associated with "language drills." This 
tradition may in part be due to the "general though by no means 
necessary association of discrete point testing with the assess- 
ment of linguistic rather than communicative competence" 
(Politzer 1982), The Influence of testing procedures and test 
content on the organization of instruction has been noted by 
Carroll, (1973), Robinson (1973) and Wilkins (1976). 

The goal of developing exercises which fit within the 
prevalent theories of second language acquisition may be 
facilitated by taking a fresh look at general learning theory and 
memory research as it applies to communicative competence, 
informal acquisition and notional categorizations. Throughout 
the discussion that follows, a series of hypotheses will emerge 
that form the experimental bases of the research in the present 
study. 
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3 MEMORY AND MEANING 

The relationship between the meaning of words and our 
ability to recall them has been the subject of a number of 
studies^ Lindsay and Norman (1977)^ for example, have suggested 
that words are stored In memory according to semantic catego- 
ries. Words and sentences which are presented together In the 
same category take less time to recall and are recalled more 
often than those presented across categories. Long-term memory 
appears to be organized on the basis of meaning rather than on 
verbatim wording or sentence structure (Sachs 1967), For this 
reason, it has long been claimed in the FL literature that speech 
which is authentic and meaningful will be recalled more accura- 
tely than speech which Is not <e,g. Rivers 1964> Robinson 1981, 
Stevick 1976). As for CAI, Schaeffer (1979, 1981) reports a 
study in which students of beginning German at the United States 
Air Force Academy achieved greater results through CAI drill 
practice requiring them to know the meaning of the sentences 
than through structural CAI drill practice without reference to 
meaning « 

Memory research supports these claims from several 
perspect i ves ♦ 

3.1 Memory and integrated context 

As discussed in Section 2, emphasis on using speech which is 
both authentic and meaningful (in terms of the speaker's inten- 
tion to communicate) Is common to theories of communicative 
competence. Informal acquisition and f unct lonal /not lonal cat- 
egorizations ♦ In contrast, Robinson (1985) has pointed out that 
disconnected Items which lack any authentic meaning in this sense 
are common to FL textbook exercises and much of the FL courseware 
currently available (cf, for example, the courseware listed by 
Harrison, 1983). Without an Integrated semantic context, 
authenticity of speech or naturalness of speech to serve a 
part icular f unct Ion can hardl y be approached * Cons Ider the 
examples below, extracted from Robinson 1985 (pp. 35-37) • 
Students focusing on a structural point such as present tense 
verb endings in Spanish are frequently given a series of Items 
such as: 

Computer model: (Ella y el) vlvlr 
(Answer ) v I ven 

1 • (Nosotros) comer 
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Similarly^ for practice in English question formation, students 
are often asked to form a question from a disconnected array of 
sentences such as; 

Computer model: The students are busy. 
(Answer) Are they busy? 

1. The dog is hungry. 

(DASHER, Pusack 1982.? 

To practice the plural form of Spanish nouns and adjectives, 
students are often asked to rewrite disconnected sentences: 

Text model: El chlco es guapo, (The boy is hand- 

some . ) 

(Answer) Los chicos son guapos. (The boys are 

handsome . > 

1, La montana es alta. (The mountain Is high.) 



2. El amigo es simpatico. (His friend Is 



Vocabulary Items to be learned or reviewed are also frequently 
presented as a disconnected array of words. For example, some 
exercises instruct students to find the word most similar to 
the capitalized key word: 

Computer model: Which word is most similar to QUIRK? 

aura. .evidence . .manner i sw. .curve . . move? 

(Answer) manner ism 

1. Which word is most similar to QUADRUPLE? 

increase . .count. . div Ide • . identical . . fourfold? 
(ANALOGIES, Radio Shack) 

Students are frequently asked to translate or rephrase 
disconnected sentences. 

Text instructions: Rephrase sentences in the negative. 

1. Me gusta jugar al tenis. (I like to play tennis.) 

2. Yolanda es alta. (Yolanda Is tall.) 

3. Uds. son jovenes. (You are young.) 

(CHURROS Y CHOCOLATE, 
Scott Foresman) 

7 
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Text Instructions: Make a sentence In Spanish in which you: 

1* Ask a classmate If he or she likes gifts* 

2, Say that the class is interesting, 

3, Tell two of your friends that they are interesting, 

(ibid.) 

None of the above exercises would be considered authentic speech 
from a native speaker's point of view. "People simply do not 
communicate in disconnected sentences or words. We read material 
on a particular topic. We hear speech within a particular 
context, if only for the duration of a sentence or two. And, 
with the notable exception of some foreign language classes, we 
write things pertaining to a particular context" (Robinson, 
1985, p. 36). 

Even when the emphasis is on linguistic competence through 
the learning of particular forms or discrete lexical itens, 
research has shown that memory for discrete items is also 
improved by providing an integrated context (ibid., p. 37). For 
example. Bower and Clark (1969) presented two groups of subjects 
with lists of ten totally unrelated nouns which they were told to 
memorize. The experimental group was instructed to learn the 
words in each list by creating a sentence or small story which 
contained all the words in a single context, however forced. The 
following is an example of one subject's response (the key words 
to be learned are given in upper case): 

"A VEGETABLE can be a useful INSTRUMENT for a COLLEGE 

student. A carrot can be a NAIL for your FENCE or 

BASIN. But a MERCHANT of the QUEEN would SCALE that 

fence and feed the carrot to a GOAT." (Bower and Clark, 

1969). 

The control group was simply told to memorize the list of 
words. On a delayed recall test, "Subjects who had made up 
stories were able to recall correctly 94% of the words from all 
the lists> as compared with only 14% for the control subjects* 
(ibid.). The smparing practice based on compre- 
hension of the sentences with practice in manipulating the form 
(see Appendix B, Day 4 and Day 7, respectively). 
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3*2 Memory^ personal reference and emotion 



Other research has shown that memory Is Influenced by the 
nature of the meaning attrlbute<J to the words or sentences. 

Self-Reference and "known other" reference. 

In an experiment conducted by Smith <1970>> students were 
asked to answer a series of yes/no questions which variously 
remparlng practice based on cowpre- 

henslon of the sentences with practice In manipulating the form 
(see Appendix B, Day 4 and Day 7, respectively). 
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3,2 Memory^ personal reference and ewotion 

Other research has shown that memory is influenced by the 
nature of the meaning attributed to the words or sentences. 

Self-Reference and "known other" reference. 

In an eKperiwent conducted by Smith (1970), students were 
asked to answer a series of yes/no questions which variously 
referred to themselves^ known others^ or were based on rhyme, 
definition or orthography. On a test of recall > words introduced 
iu questions about themselves were recalled by subjects wore 
than twice as often as words in questions about others or 
questions asking for definitions, or questions requiring deci- 
sions regarding whether words rhymed or were capitalized. Those 
questions referring to known others comprised the next largest 
group recalled. Robinson replicated the experiment informally 
in 1980, 1981 and 1982, and obtained identical results with 
varying populations, including university students, elementary 
school teachers and language teachers. In all of the experiments 
"word definitions" were the third and fourth smallest class of 
words to be recalled (Robinson, 1985). 

These findings have Important implications for second 
language teaching in view of the predominance of exercises 
containing material referring to anonymous others of the "Dick 
and Jane" type ("Jane is a secretary"). This research would 
suggest the hypothesis that exercises containing material 
referring to the learners themselves or to known others would be 
more effective than those referring to* anonymous others. The 
present study examines this hypothesis^ comparing parallel 
exercises referring to known others and anonymous others, 
respectively (see Appendix Day 2). 

Emotion 

Robinson (1981) cites studies showing that language 
acquisition Is facilitated when the speaker/ learner Is personally 
Involved with the messages conveyed through the second language. 
In these studies, materials were chosen and exercises were 
organized so as to elicit a subjectlve> emotional response from 
students . One of the hypotheses that emerged through these 
studies was that "emotional association may play as critical a 
role (and possibly a more critical one) la language associations 
and proficiency as do cognitive associations" (Ibid.). These 
findings have been explained In terms of the "depth of process- 
ing" of the learners' messages (Stevlck 1976, Lindsay and Norman 
1977). Stevlck's discussion of memory concludes that "other 
things being equal, the Meeper' the source sentence within the 
student's personality, the more lasting value It has for learning 
the language." He suggests that this "depth factor" may be more 
Important to language acquisition than "technique of formal or 
underlying linguistic analysis." 

10 
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In his analysis of the motivational aspects of computer 
games^ Malone C1981) suggest? that the stimulation of emotion 
through fantasy constitutes one of three critical motivational 
components^ He distinguishes between "extrinsic fantasies" that 
are not particularly related to the skill used in the game, and 
"intrinsic fantasies" which are skill-related. The notion of 
stimulating emotion through intrinsic fantasy has important 
implications for the development of FL exercises in which 
emotional stimulation is inherent in the particular Intended 
linguistic goalCs). 

Observations and research regarding the relationship between 
memory, emotional meanings and motivation suggest the hypothesis 
that material which stimulates emotion would be more effective 
than material which does not. This study compared exercises which 
isolated humor vs. non-humor from otherwise linguistically 
parallel material (see Appendix B, Day 5>. 

3.3 Memory as a product of comprehension 

Clark and Clark (1977) suggest that "meaning" refers to the 
product of the listener's comprehension, i.e. the "gist" or 
general ideaCs) that remain in memory from what the listener or 
reader has heard or read: 

"The listener's main goal in comprehension is to 
integrate the new information from assertions with 
v;hat they already know, to find answers for ques- 
tions, to develop plans for instructions, and 
so on" tsicJ. 

This observation gives rise to several notions which are critical 
to the development of communicative competence. First, it Is 
clear that comprehension involves the learner actively. Second, 
comprehension draws upon what the learner already knows. In the 
process of comprehension, listeners draw inferences and build 
global representations about what they hear* 

"Global representations and the importance of prior knowledge: 
implications for student "menus" and dialogue branching-- 

Research shows that facts which fit within the listener's 
global representation of meaning are more easily remembered than 
those which do not. Global representation of meaning refers to 
the general context of what the listener already knows. De 
Vllllers C1974) shows that sentences which are perceived as 
fitting within a story are better remembered than similar 
sentences which are perceived as disconnected. Similarly, a 
study by Bransford and Johnson C1973) shows that facts which do 
not fit within a part icular representation of meaning are 
remembered less than those that do. Two groups of people were 
read the same passage. However, each group was given a different 
title for the passage before hearing It. One group was given the 
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title "Watching a Peace March from the Fortieth Floor." The 
other group was given the title, "A Space Trip to an Inhabited 
Planet." The passage was as follows (emphasis added): 

"The view was breathtaking. From the window one 
could see the crowd below. Everything looked 
extremely small from such a distance, but the 
colorful costumes could still be seen. Everyone 
seemed to be moving in one direction in an 
orderly fashion and there seemed to be little 
children as well as adults. The_larxding_was_gentie 

iiliilEiiliiliiliiEQl '^At"fTrst""there~was"a'"great 
deal of activity. Later, when the speeches started, 
the crowd quieted down. The man with the television 
camera took many shots of the setting and the crowd. 
Everyone was very friendly and seemed to be glad 
when the music started" (ibid.). 

On a test of recall, the group given the title "Watching a Peace 
March..." was not able to recall the sentence about the landing, 
underlined above. However, the group given the title about the 
space trip was able to recall the sentence significantly more 
often. Within the context of a space trip, a "landing" fit in 
with subjects' prior knowledge; it did not, however, fit into 
the other group's assumptions concerning a "peace march." 

Rubin (1981) also reports that students' prior knowledge of 
narrative structures influenced student ability to create a 
collective story from individual sentences, using the "strip 
story" technique of Gibson (1975). " Similarly, prior knowledge 
should also affect acquisition and organization of new linguistic 
elements. For example, the concepts of the verbs SER and ESTAR 
or the past progressive tense In Spanish, or reading comprehen- 
sion skills, should be more easily acquired if these structures 
are connected to students' prior knowledge base. A "menu" of 
topics could afford students the opportunity of choosing such a 
knowledge base. One could thus hypothesize that students who 
were able to choose from a "menu" of topics to provide the 
general context of instruction would achieve the goals of 
instruction more effectively (regardless of the particular goals) 
than those who were not able to make such a choice. The present 
study compared student choice of a story from a menu of topics 
vs. automatic story assignment, using otherwise parallel exercis- 
es (see Appendix B, Day 9). 

--Drawing inference, guessing and problem solving: implications 
for the development of exercises and forms of error corrections- 



Research regard i ng the character i s t ics of good second 
language learners (Nalman, Frohlich and Stern 1975) and the 
strategies they use (Rubin 1981; Rubin and Thompson 1982) 
coincides with Clark and Clark's observation that comprehension 
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In any language requires the listener to actively draw Inferences 
about the situation being described: "Good learners »ust modify 
their rules for both Inductive and deductive reasoning on a 
continuous basis If they are to approach communicative compe- 
tence" (Rubin 1980. 

These conclusions have important Implications for the 
presentation of material to be learned In language exercises as 
well as for forms of error feedback. 

— Student discovery stategles for exercises-- 

If good learners actively draw inferences about what they 
read or hear> using both Inductive and deductive reasoning^ It 
would follow that exercises which require students to draw 
Inferences through problem solving and guessing would encourage 
good learning stategles and Improve linguistic as well as 
communicative competence more than exercises which did not 
require such active Involvement. While a few CAI simulations In 
foreign languages do require guessing <e.g. "Mystery House"), 
most FL exercises do not. Even those that do often take the role 
of supplementary games which are isolated from the goals of 
Instruction. In the present study, ' exercises which require 
students to describe pictures are compared with exercises which 
require students to solve problems. The same graphics, vocabulary 
and syntax are used (see Appendix B, Day 6b). 

--Student discovery strategies for error feedback— 

If good language learners actively draw Inferences about 
what they read or hear, It would also follow that CAI which 
guided students In the discovery of their own errors would 
Improve achievement more than forms of error feedback which 
merely gave students the correct answer and/or explained the 
correct answer automatically, following a student^s Incorrect 
trial or request for help. 

Computer response to student errors has been referred to 
variously as "answer Judging," "answer processing," and ''error 
correction." Most existing foreign language CAI draws students' 
attention to errors In one or two of the following ways: 

1. After the student's first and/or second incorrect trial, 
the computer responds: "wrong, try again." 

2. After the student's first, second or third incorrect 
trial , the computer responds : "Wrong, [ student 's 
name]. The correct answer is " 

3. After the student's first, second or third Incorrect 
trial or the student's request for help, the computer 
responds with an explanation of the correct answer 
appears, regardless of the particular uature of the 



student's mistake. 
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4- After each student error up to three Incorrect trials> 
the computer "lucates" the error by underlining or 
deleting the Incorrect characters which do not watch 
with the correct response (e.g. Pusack's DASHER). 

Only the fourth Method of error correction stimulates active 
student discovery of their own errors* Unfortunately, this form 
of error correction is limited in two ways. Firsts simple 
location, of error cannot distinguish between spelling errors, 
typosr grammatical problems, or comprehension problems, and hence 
it cannot guide students to discover why they made the error or 
how to remedy It. Second, there are certain kinds of errors, 
such as those due to the incorrect comprehension of lexical 
items, for which location of the error Is meaningless. For 
example, suppose the Instructious ask students, "Which word is 
similar to 'hot dog'?*" The choices are: salad, sandwich, 
vegetable, dessert. A student marks "salad." For this student, 
locating the error gives no more clues than the rejoinder, 
"Wrong, try again,^" 

Computers are capable of responding differently depending on 
thenumber and type of errors a student makes. Burton and Brown 
(1979) have suggested that "computer-based tutoring/coaching 
systems have the promise of enhancing the educational value of 
gaming environments by guiding a student's discovery learning." 
Computers are capable of "coaching" students who make mistakes by 
responding with hints which are graded In terms of type of error 
and number of Incorrect trials a student makes on the same item. 

EnBASIC by Compress Is an augmented programming language 
which goes a step In this direction. Not only are errors 
located, they are marked up with a system of symbols designed 
to Identify the type of error, e.g. number^ gender, tense, word 
order, etc. Unfortunately, the symbols are quite complex and may 
be difficult for students to decipher. 

Underwood and Basse in (1985) have recently developed a 
foreign language software package which uses a parsing routine to 
detect errors In student Input. When errors are found, the 
program points them out (through inverse display or "highlight- 
ing"), at the same time that it gives the student a hint as to 
the type of error, usually in the form of a question. For 
example, if the student makes an error in gender agreement, the 
program will highlight the two mismatched forms and ask, 

"Masculine or feminine?" 

Other programs are beginning to appear which not only give 
graded hints In relation to misunderstood vocabulary, but also 
act as a tutorial in leading students to d iscover correct 
responses <cf. "French Achievement," "Spanish ConClues Ion" , 
"Mesaventures Culturelles") . 
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The theory and research throughout this section suggests 
that the most beneficial fons of error feedback would stimulate 
pv-oductlon of inferences and guide students to DISCOVER the 
correct responses as well as the reasons for their errors, such 
as those discussed above* In the present study, forms of error 
feedback are developed and compared which isolate degrees of 
student discovery. These forms include; automatic disclosure of 
correct answers, correct answers with explanations, location of 
error only, and location of error with hints <see Appendix B, 
Day 3) . 

The notion of "implicit" vs, "explicit" correction is also 
related to the question of student discovery. Implicit error 
feedback may be signalled by a simple "pardon?" which implicitly 
asks for clarification. It may also include implicit modeling, 
rather than overt correction <cf. Terrell 1982) • For example > 
suppose a native Spanish speaker responds to the English 
question, "How old are you?" with "I have 15 years." Whereas 
overt correction would involve modeling the correct answer itself 
("No, I AM fifteen •..), implicit modeling would embed the 
correct structure within a conversational response: "Oh, you say 
you are 15. . . tcont inulng with the conversation! .Do you have any 
brothers?" etc. Implicit feedback thus allows more opportunity 
for student discovery of errors. This study compares achievement 
on identical exercises which differ only in Implicit vs. explicit 
feedback <see Appendix B, Day 10). 

"Student control" versus "program control" is another 
related Issue. It has frequently been pointed out that one of 
the advantages of CAI Is that students may "control" their 
learning experience <cf. Smith et al . 1975J Merrill 1980; Soper 
1982). At the same time, critics argue that one of the chief 
drawbacks of ^classical" CAI Is precisely that students do not 
control enough, that In fact the program controls them <cf. 
Papert 1980, Hlgglns and Johns 1984, Underwood 1984). In 'any 
case, the benefits of "student control" have yet to be confirmed 
by research. 

Kadesch (1981) reports that of Keller's five elements in a 
Personalized 3yste» of Instruction <PSI), the notion of "self- 
pacing as opposed to Instructor-Imposed constraints on pacing was 
unimportant If not detrimental to learning." Other studies have 
shown that when students control the amount of instruction they 
receive, they often quit too soon and fail to learn what they 
should (Stevens 1982). When students have different forms of 
help and review aval lable after making an error, Howe and 
DuBoulay (1979) have found that students "simply hit the help 
button for the correct answer rather than use the computer in a 
cognitive way." Theory would favor a mid-way position which 
al lows both "student control" In dec Idlng whether help Is 
desirable, and allowing "program control", acting as the teacher 
or "expert" who designates which particular kind of help Is 
appropriate. If students could diagnose their own errors com- 
pletely, there would be no need for "teachers" or experts. 
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i Clearly, the Issue of "student control" Is still in need of 

I research* 

I 

In the present study, various forms of program-controlled 
^ feedback and student-controlled help are compared: programmed 

! correct answers with no further "help"! student controlled 

I request for help followed by programmed decision as to which help 

j Is appropriate; and totally student controlled help In which the 

student requests help and then selects the kind of help desired 

from a menu (see Appendix B, Day 8). 

ft 

3.4 Memory and spaced practices Implications for forms of 
error correction 

Behavior modification research suggests the notion that 
repetition of Items to be learned at spaced Intervals Increases 

m learning. Conditioning theory (Skinner 1953) and social learning 

theory (Bandura 1977)> claim that learning takes place with 
repeated exposure, over time. This notion has Important Implica- 
tions for methods of error correction In CAI, As mentioned, the 
computer has the capability of responding to student errors In 
particular ways. The above-mentioned theories of behavior 

I modification would support the hypothesis that CAI programs which 

repeated the same or parallel Items missed by a given student at 
spaced Intervals would be more effective than those which did not 
repeat the Items at all (which Is current practice In most 
foreign language CAI), those which repeated the entire drill, or 
those which repeated all Items missed by the student together » 

I at the end of the entire exercise. The present study compared 

four ways of recycling missed Items; Immediate repetition of the 
same Item; Immediate repetition of a parallel Item (Immediate 
repetition of missed Items by way of parallel Items might allow a 
sense of "spaced practiced" conceptually); repetition of the same 
Item at spaced Intervals* and repetition of all mistakes toge- 

^ ther, at the end of the exercise (see Appendix B, Day 6a). 
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PART TWO: DESIGN OF THE STUDY 



4 OVERVIEW OF DESIGN AND SPECIFIC OBJECTIVES 

In the introduction to this study, we posed the quest ions> 
•What kinds of exercises are most effective in foreign language 
instruction in general > and what kinds of exercises are most 
effective in foreign language instruction when the computer Is 
used as a medium?" In the course of the preceding discussion of 
second language pedagogy, memory research and computer capabili- 
t ies> several specif ic hypotheses emerged which suggested 
particular pedagogical princlples> answer judging strategies^ and 
their respective CAI treatments in foreign languages ♦ The 
specific objectives of this study were to develop CAI exercises 
which compared these suggested •experimental" treatments with 
contrasting "control" treatments* A different hypothesis with its 
respective treatments was introduced daily ♦ For the purposes of 
research, students had CAI treatments exclusively during the 
two-week field study> without classroom instruction. 
Also for the purposes of research, each suggested pedagogical 
principle and feedback strategy was examined independently in 
order to clearly identify what made up the experimental and 
control treatments, respectively. While such isolation of CAI 
from classroom Instruct ion> and such singular treatment of 
pedagogical and answer- judging principles would not be desirable 
for FL courseware> they were necessary first steps in research^ 
In these ways> the particular principles and strategies* that 
contributed to final achievement results could be clearly 
identified for future combined application to PL courseware. 

The specific hypotheses are summarized below* A summary of 
their respective daily treatments follows in Section 5.3, 

4.1 Pedagogical hypotheses 

PI. The provision of an integrated context for the introduction 
of discrete structural items will Improve memory and 
subsequent learning of the Items (day 4). 

P2. Practice In which the student is focused on the meaning of 

the material will lead to greater learning of structural 

Items than will practice in manipulating the structures 

themselves> without reference to meaning (day 7>. 

P3, Exercises containing material which refers to known others 
will be more effective than those referring to anonymous 
others (day 2) . 

P4. Exercises containing material which personally involves 
the learner because of Its emotional or humorous content 
will be more effective than those with non-emotlonal 
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material <day 5). 

P5. Students who are able to choose from a ••menu" of topics to 
provide the general context of the exercise will achieve the 
goaKs) of the exercise more than those who are not able to 
make such a choice (day 9). 

P6* Exercises which require students to draw Inferences through 
problem solving and guessing will be more effective than 
those which do not (day 6b). 

4,2 Answer- judging hypotheses 

AJK Student discovery strategies: feedback which actively 
engages students in discovering the correct responses as 
well as the source of their errors will be more effective 
than that which does not (day 3): 

( 1 ) feedback wh Ich pro v Ides e xpl ana t ions of errors or 
locates errors will be more effective than that which gives 
correct answers only; 

(2) feedback which provides a series of graded hlf,nts related 
to the particular Item (l.e.> provides progressively more 
information) will be more effective than that which either 
provides explanations of errors or locates errors only, 

AJ2 Student control vs, program control: feedback which combines 
student controlled help and programmed or "expert" feedback 
will be more effective than either student or program 
controls exclusively (day 8), 

AJ3* Implicit correction of errors will be more effective than 
explicit correction of errors (day 10), 

AJ4. Repetition at spaced Intervals of items missed by students 
will be more effective than: 

(1) repetition of the same or parallel item ImmedUitelyi or 

(2) repetition of all Items missed at the end of the entire 
drill (day 6a)- 

5 CAI MATERIALS: RESEARCH AND DEVELOPMENT 
5 A Research 

Prior to undertaking the development of new CAI exercises 
for this 3tudy> project staff first reviewed and analyzed a 
wide range of existing foreign language courseware, with a view 
to adopting or adapting strategies which would exemplify the 
hypotheses of the study* Existing materials tended to exemplify 
"control" treatments with respect to the pedagogical hypotheses. 
Answer judging strategies were found which exempl If led both 
experimental and control feedback treatments* particularly with 

18 



respect to student discovery stragles <AJ1 above) • The relative 
effectiveness of, for example, DASHER-type error location strate- 
gies were compared with more typical "wrong, try again* feedback. 
However, existing courseware acted only as a guide. <See Appendix 
H for a listing of computer software and specific FL courseware 
adapted for use in this study*) Due to the task of isolating 
pedagogy and feedback daily, in tandeci with the school's curricu- 
lum goals for the field study, i.e., the particular linguistic 
goals set by the classroon teachers, all exercises were designed 
and programmed esp«5cially for the particular research purposes. 

5.2 Development of materials for the study 

All CAI materials used in the field study were especially 
developed and programmed by the project staff over a six-month 
period. Activities were first designed by staff members on 
paper, reviewed thoroughly for their pedagogical and linguistic 
content in relation to each hypothesis, and then programmed on 
the Apple He in the "C" language, using the Aztec C-co»piler 
developed for that machine. 

Before determining the final content of the lessons, a 
"student interest survey* was administered to the students who 
would be participating in the study. Based on this survey, 
situations and vocabulary used In the lessons were tailored 
to the interests of their intended audience. <See 6.2.2 for 
results of this survey.) 

5.3 Brief dcfscrlptlon of CAI materials: daily experimental and 
control treatments 

The following is a brief outline of the daily CAI lessons 
and the various hypotheses which they test, for a complete 
description, including details of the various answer- j udglng 
comparisons, ^ee Appendix B. When answer- judging strategies were 
being compared, the exercises were identical, differing only in 
error feedback. When pedagogical principles were being compared, 
both experimental and control groups had the same vocabulary and 
syntax, differing only in the one variable being compared. New 
vocabulary and/or syntactic items were introduced and tested with 
each hypothesis. 

Day 1 Computer orientation 

Introduction to the use of the computer, special keys 
for Spanish characters, and the format of various 
exercises from the lessons to be covered. 

Day 2, Hypothesis P3: Known vs. anonymous other 

Experimental group ass igns names of favorite singers, 
movie stars, etc., to the characters in the narration; 
control group characters are anonymous "Dick and Jane" 
types . 
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Day 3, Hypothesis AJl: Student discovery 

Both groups complete the same exercise, but with four 
different types of feedback on errors: correct answer 
only; correct answer with explanation; error location 
only; error location with graded hints. 

Day 4, Hypothesis PI: Integrated vs. non- integrated material 
Exper Iwental group reads sequenced, chronological 
narrative about same two characters; control group reads 
unconnected sentences about different, unrelated, 
characters. Sentences for both groups are identical in 
vocabulary and syntax. They differ only in character names 
and sequence. 

Day 5, Hypothesis P4: Humorous material vs. non-humorous material 
Experimental group reads and answers questions about 
humorous dialog; control group reads and answers questions 
about similar, non-*humorous dialog. 

Day 6a, Hypothesis AJ4: Recycling of missed items 

Both groups read narrative on clothing and practice 
completing sentences about things they wear; mistakes 
are handled in four different ways with respect to 
recycling of missed items: immediate repetition of same 
item; immediate repetition of parallel item; repetition of 
same item at spaced intervals; repetition of all missed 
items together at the end of the exercise. 

Day 6b, Hypothesis P6: Problem-solving vs. non«problem-sol v ing 
Experimental group must solve scrambled-picture puzzle in 
order to answer questions; control group answers questions 
based on unscrambled pictures before them. Vocabulary and 
syntax are identical. The graphics are the same during 
initial lesson presentation and differ only in their 
position during activities that follow* 

Day 7, Hypothesis P2: Meaningful vs. manipulative practice 
Exper i mental group pract ices mater lal with quest ions 
referring to the meaning of the passage; control group 
practices without reference to meaning. 

Day 8, Hypothesis AJ2: Program vs. student control 

Both groups are given a chart of information on the basis 
of which they must answer questions; feedback on errors 
compares degrees of student-controlled help with the use 
of automatic help screens. 

Day 9, Hypothesis P5: Choosing passage from menu vs. no choice 
Experimental group selects one of four stories to read; 
control group has no choice of story* Activities are 
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parallel, but relate to the specific story chosen or 
ass Igaed. 

Day 10, Hypothesis AJ3: Implicit vs* explicit correction 

Both groups are given a "Mad Lib" exercise in which the 
program prompts for words, then displays a sUiy story I 
feedback on exercise compares explicit correction, 
le. "No, the answer Is****, with Implicit correction 
through questions which Implicitly model the correct verb 
form, while appearing to probe for more Information* 

5*4 Pilot Testing of Materials 

Materials which were developed for use In the field study 
were first pilot tested with two different groups of students* 
First year Spanish students from Mills College, Oakland, Califor- 
nia, were used to pilot test the materials for "debugging" on a 
voluntary basis* A subsequent, larger, group of first year 
Spanish students from Montera Junior High School — none of whom 
later participated In the actual field study — used the materials 
during a two-week period to determine if they were of appropriate 
difficulty and to Identify pedagogical problems as well as 
additional computer "bugs"* For example, during the pilot testing 
of Day 2, students In the experimental group were asked to type 
In the name of their favorite singer* One student entered a rock 
group's name, "Frank le goes to Hollywood," and the program 
crashed! (The program had been written to anticipate up to two 
words only*) 

Based on pilot test results, extensive revisions were 
made: elimination of such "bugs", revision of computer orienta- 
tion activities to Increase "user friendliness") revision of 
lesson Instructions) lengthening of most exercises and the 
addition of a "help" feature which would allow students to look 
up the current vocabulary list during the presentation stage of 
each activity^ 
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Field study design 



6.1 Field study: overview 

Students in the field study population were randomly 
assigned to experiwental and control groups. For a 45-minute 
period each day over a period of nine days all students received 
their Spanish instruction exclusively by Means of the computer 
materials designed for this pro ject. Student textbooks were 
stored during the study to avoid possible influence on lesson 
treatments. The CAI activity for each day was based on a single 
hypothesis in order to clearly separate variables and the 
resultant effects attributable to experimental or control 
treatments. Evaluation was carried out in two ways: <l) daily 
achievement tests following the completion of each day's lesson, 
and <2> pre-test and post-test of all new material introduced 
during the study. The latter tests were identical! the pre-test 
was given immediately prior to the study, the post-test a few 
days after the completion of the nine-day period, follot?ing a 
weekend *s delay. 



Although data were collected each day, it was not anticipat- 
ed that major differences would be found on a dally basis, given 
the short duration of daily treatments and the immediacy of the 
testing. It is important to reiterate that the hypotheses 
central to this study (see 4.1) have their foundation in memory 
theory, in particular the various factors which influence the 
learner's retention of linguistic material on delayed recall 
tasks. In order to evaluate longer-term effects, group assign- 
ments were maintained throughout the study so that comparisons 
could be made of the cumulative effects. 

Following the 9-day field study period, students were 
comprehensively tested over the entire range of mater ial* Each 
section of the post-test, like the pre-test, reflected the 
instructional goals of a particular hypothesis. While it would 
have been desirable to re-test the students after a longer 
period, any results obtained would have been contaminated by 
teacher intervention following the computer study (teachers 
reported that they intended to review the material given in the 
instructional unit) . 



6.2 Field study population 

The field study population consisted of junior high school 
students in their second semester of second-year Spanish at 
Montera Junior High School, Oakland, California. Eighty-three 
students in three Spanish classes, normally taught by two 
different teachers, took part in the study. 
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Students were randomly assigned to fixed groups. Pour groups 
were required in order to test the answer-judging hypotheses on 
days three, six, and eight. The four groups were formed Into two 
primary groups, control and experimental, for the purposes of 
testing the hypotheses on the remaining days. Table 1 displays 
basic student demographics broken down by primary experimental 
and control group assignment. Table 3 displays the test means 
and T-test probabllllty values for each of the pre-test measures. 
Note that there are no statistically significant differences 
between groups on any of these measures. 

6,2. 1 Description of field study population 

k background questionnaire administered at the beginning of 
the study showed that the students were ethnically quite mixed 
(50% minority) and many were from professional families (43% of 
parents In professional occupations), though a wide range of 
professions were represented. (See Appendix A for the complete 
Background Questionnaire with responses.) By far the majority of 
the students (86%) had had some previous hands-on exposure to 
computers, ranging from "mlalmal* (51%) to "experienced" (35%). 
Not surprisingly, perhaps, experience with computers for the most 
part meant games (57%); however, 32% had had some experience with 
either educational programs (18%), programming (8%), or word-pro- 
cessing (8%>. Overall Interest In computers was high (39% were 
•very Interested"; on a 1 to 4 point scale, from low to high, 
the mean score was 3.2.). 

Overall attitudes toward the study of Spanish were average. 
When asked how Interested they were In learning Spanish, the mean 
was 2.8 on a 1 to 4 point scale. When asked to compare their 
enjoyment of Spanish In relation to other subjects, the mean was 
2.3. 

The questions designed to measure attitudes toward Spanish 
speakers showed a marked difference between their general 
Impressions of Spanish-speaking people (16% negative. Item #17) 
and their particular Impressions of Spanish-speaking people 
("someone with a Spanish accent") they had actually met (3.6% 
negative. Item #21). These findings replicate those of a similar 
study conducted by Robinson In Australia In which It was conclu- 
ded that general Impressions reflect unconfirmed stereotypes, 
usually based on limited Information and indirect experience 
while particular Impressions reflect specific direct experience, 
favorable or unfavorable, Ue. "familiarity may breed contempt" 
in the perception of differences, while "familiarity may Increase 
liking" in the perception of similarities (Robinson 1981:56). In 
any case, once negative general Impressions are formed, they are 
resistant to change through subsequent particular favorable 
information (Robinson 1985). 
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No significant dlffek*ences between experimental and 
control groups were found with respect to any of these attitude 
Measures* (See Section 9*2 for a discussion of attitudinal 
changes which occurred during the study.) 

6.2.2 Student interest survey 

As mentioned in Section 5.2^ the field study population was 
given a Student Interest Survey early in the development of the 
CAI materials so that content could be tailored to their 
interests. This survey consisted of 14 open-ended and 3 forced- 
choice questions; results included both expected and unexpected 
answers* 

Under the heading of "expected" results are student tastes 
in consumer products: favorite toothpaste (Crest)> soft drink 
(Coke)# and clothes for school < jeans). Also predictably^ 
their most difficult school subjects were math and algebra^ their 
favorite sport was football, and what they most liked to do on 
Saturday afternoons could be summarized as "hanging out with 
friends. " 

Other results only point to the difficulty that adults have 
in trying to second-guess adolescent interests--or keep up with 
rapidly-changing fads: Although the staff suspected that Michael 
Jackson would be one of their favorite male singers (this was in 
February of 1985)> he was only mentioned once> while Prince was 
mentioned In 45.6% of the responses. Favorite female singer was 
Madonna, whom none of the adult staff had heard of at that time. 
Their favorite male movie star was Eddie Murphy ("Beverly Hills 
Cop" was the big box office hit at the ti«e)> their favorite 
female movie star--inexpl icably--was Marilyn Monroe. 

In trying to determine what types of stories would interest 
the group (so as to offer them the right options in the choice- 
of-story activity on Day 8>> we found that romances (25%) were 
preferred to science fiction (18%)> which was all the more 
puzzling when considering that the population was 60% male. 
Finally^ when asked what aspects of Spanish culture they liked 
best, the most frequently mentioned was the food> although it is 
doubtful that most students had a clear Idea of the distinction 
between "Spanish food" and what they may eat at a nearby fastfood 
taco stand. Other "cultural" aspects they liked included dancing, 
lifestyle, "the way they talk" and> curiously, "the drinking 
age"— a possible reference to the imagined free-flowing wine in 
Spanish-speaking countries. The student interest survey pointed 
to a simple, but often overlooked- part of curriculum materials 
development: if educators and curriculum developers aim to tailor 
materials to student interests, it is important to ask intended 
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students what they are interested in. 



6.3 Pre-testing procedures 

Students were given two tests prior to the study: (1) the 
Pimsleur Language Aptitude Battery <PLAB>, consisting of four 
subscales: Language Analysis^ Sound/symbol Associat ion> Sound 
Discrimination, and Vocabulary (see Appendix E>; and <2> a 
specially constructed test of prior knowledge, based on the 
material to be covered in the different CAI activities of the 
project materials (this same test was also used as the post-test; 
see Appendix D> . In addition, project staff collected student 
scores on the California Test of Basic Skills <CTBS> Composite 
Language and Reading tests. Finally, students were asked to 
complete a questionnaire on their backgrounds. Interests and 
attitudes (see Appendix A>. 



6.4 Field testing procedures 

Each day of the nine-day period, students were given a 
different program diskette to use for that day's lesson; the 
particular version of the lesson they received (experimental or 
control) depended, of course, on which group they were assigned 
to for the duration of the study. In addition, each student 
received a diskette on which to record the data collected for 
that day. Lessons averaged 15-20 minutes in length. Staff 
members in attendance were allowed to assist students in any 
problems that arose regarding the use of the computer or program 
Instructions, but did not assist them with difficulties concern- 
ing the content of the lessons. 

As soon as each student had been through the day's lesson 
once, including the tests at the end, the data disk was collected 
by the staff members present. Students were not permitted to go 
back and "improve* their day's scores. Most students did, 
however, practice the lessons again after turning in their data 
disks, with a view to improving their final overall score. (See 
Sections 6.5 and 10.3.2 for a discussion of the possible effects 
of this practice on daily test results.) 



6.5 Evaluation 

Each day during the nine-day period students completed short 
tests at the end of the day's activity. The number of tests, as 
well as the number of items per test, varied for each day (see 
Table 4). 

Tests were of four types: integrative recall (IR>, integra- 
tive production (IP), discrete recall <DR>, and discrete produc- 
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tion (DP), In the literature on PL testing^ "integrative" tests 
generally refer to those which elicit responses considered to 
draw upon global skills^ e.g. cloze tests# dictation, comprehen- 
sion questions, etc. Such tests tend to be associated with 
•communicative competence." "Discrete" tests generally refer to 
those which elicit responses considered to draw upon one particu- 
lar skill or elicit a specific lexical or syntactic manipulation. 
Such tests tend to be associated with "linguistic competence". 
Test Items were categorized according to the latter distinctions 
and verified by the Senior Project Adviser^ Prof. Wilga Rivers 
(see Appendix C for sample tests). It Is Important to note, 
however, that the distinction between Integrative and discrete 
tends to be blurred somewhat when applied to short tests which 
must necessarily Involve recognition and/or production of limited 
structural or vocabulary Items Immediately after such Items have 
been taught. As mentioned earlier, the dally presentation and 
testing of new structural or vocabulary Items was essential 
to Isolating the effects of particular treatments. Within the 
short time span of the two-week field study, only finite curricu- 
lum goals could be measured. In this sense, then, most of the 
dally tests were In fact discrete. (See further discussion 
In Section 10.3.2) 

At the conclusion of the study, students took the achieve- 
ment post-test (Identical to the pre-test), the Plmsleur Language 
Aptitude Battery, and completed a shorter version of the survey 
fociislng on attitudes that might have changed as a result of 
their work during the study. Overall achievement In the study 
could clearly not be measured solely on the basis of gains 
between pre- and post-tests # but needed to be considered In light 
of differing backgrounds, aptitudes, abilities and prior achieve- 
ment In Spanish. For this reason a number of statistical 
analyses were carried out which take Into acco'.nt these mediating 
factors (see Section 7). 



7 Stat 1st leal Procedures 

7.1 Data analysis tasks 

There were four data anal ys I s tasks . The f Irst was to 
examine student scores on the pre and post measures In order to 
determine If there was a difference In student achievement 
overall. In absolute terns and In light of aptitude, attitudes, 
abilities and Spanish achievement. Immediately prior to the onset 
of the study. The second task was to examine student test scores 
for each of the dally activities which Isolated each particular 
pedagogical principle and answer-judging strategy. The third task 
was to explore possible student attitude changes, as well as 
aptitude changes as measured on the PLAB, from pre- to post- 
study. Finally, the Individual tests themselves were examined In 
order to determine if they clustered along a priori dimensions of 
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•integrative* and "discrete", 
7,2 Data analysis procedures 

The actual data analysis proceeded in the following manner: 

(1) A table of Intercorrelat Ions involvi.ig all measurement 
variables was produced in order to explore two questions: First 
it was felt that even though students' assignment to groups was 
random^ and that tests on the pre-measures revealed little 
difference between the groups as they were constructed. It was 
still probable that prior knowledge, aptitudes and/or attitudes 
would influence achievement. The correlational analysis made 

it possible to identify possible covariates for use in subsequent 
tests using analysis of covariance* 

(2) The difference between the group means for the four 
answer-Judging groups on days 3, 6, and 8 were tested using 
one-way analysis of variance. For any of these tests which 
proved significant, a subsequent multiple pairwise comparison 
was conducted using the Tukey-Kramer method, 

<3) The differences between Control and Experimental group 
means on each of the daily tests for days 2, 4, 5, 6b, 7, 
and 9, the difference between Control and Experimental group 
means on the achievement tests, the PLAB, and the attitude 
measures, and, finally, the difference between Control and 
Experimental group means for gain scores on the achievement, 
PLAB/ and attitude measures, were all tested using T-Tests, 
A T-Test was also used to test the difference between the two 
answer- judging group means on day 10, 

<4) In addition, the table of intercorrelat ions described 
in <1) provided a first-level view of how the daily tests grouped 
together. This analysis helped later in determining the 
appropriateness of the clustering procedures. 

Based on information provided through the correlational 
analysis, a number of subsequent tests were performed utilizing 
analysis of covariance procedures, Covariates included 
pre-ach ievement scores, several of the PLAB subscales, CTBS 
scores and pre-attitude scores. These types of analyses were 
performed both for daily test scores and for gain scores on the 
ach ievement test , 

Several attitude scales were also analyzed pre- and 
post-study to determine If students changed their feelings 
towards the computer, the Spanish language and/or Spanish- 
speaking people, and their rationale for taking Spanish classes. 
Simple T-Tests (for testing the null hypothesis that total group 
mean gains were zero) were used for these analyses, 
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7,3 Data entry 

All of the above data were scored by hand and keypunched on 
an IBM PC, Th^se raw files were then transferred to a large IBM 
mainframe computer at Stanford University* The Statistical 
Analysis System (SAS> was used for all analyses* The principal 
SAS system data set contains 83 observations* with a total of 164 
var lable3--roughly 14^000 data points In all* 



28 



* ERJC 34 



8 OVERVIEW OP RESULTS 

The major finding of the study Is that the experimental 
group significantly outperformed the control group on the 
cumulative post achievement test gain scores • These scores are 
consistently In favor of the experimental group both In absolute 
terms and when scores were mediated by prior knowledge, aptitude, 
attitudes and abilities, giving strong evidence In favor of the 
experimental hypotheses and their treatments. 

Several other Interesting results were obtained: 

0 Results of the short dally tests are mixed. (As dis- 
cussed earlier, these tests Immediately followed the dally 
treatment of one particular pedagogical principle or answer 
judging strategy and of necessity focused on the aspects of 
vocabulary and grammar newly Introduced that day.) Results 
generally favor the experimental treatment on error feedback days 
(days 3, 8, 10), were mixed on days 4, 5, 6b, 9, and favor the 
control group on days 2 and 7 (see Section 5.2). 

0 The best predictors of achievement for all students, 
regardless cf treatment, were Interest and enjoyment of Spanish, 
(a pre-measure on the background questionnaire). 

0 The other successful predictors of achievement were the 
-language analysis" subscale of the PLAB, and the CTBS reading 
score. These findings suggest that the achievement tests actually 
favored the control group, who had more practice in manipulating 
grammar. Despite this disadvantage, the experimental group still 
outperformed the control group on the cumulative post achievement 
test, which Involved long-term memory and delayed recall, 

0 The experimental group also outperformed the control 
group on post PLAB vocabulary test gain scores* 

0 Attitudes toward computer study, Spanish study or 
Spanish-speaking people did not appear to change significantly 
during the study except In one dimension: there was a significant 
post gain In integrative motivation for the group as a whole. No 
significant differences were found between experimental and 
control groups on any attitude dimension. 

A detailed discussion of the above findings follows* 
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ATTITUDES, OPINIONS AND OBSERVATIONS 



9.1 Attitudes as predictors of achievement 

The correlation table (Table 6) shows that initial interest 
in and enjoyment of Spanish (items #14 and #15, Student Back- 
ground Questionnaire, Appendix A) were more related to achieve- 
ment than any other variables, including prior knowledge of 
Spanish (pre-achie vement test) , language aptitude (PLAB) or 
literacy (CTBS scores). This finding coincides with previous 
research regarding the relationship between motivation and 
language achievement (cf., for example, Lambert et. al, 1962). 

9.2 Pre-post changes In attitudes 

As mentioned In the Introductory summary> attitudes toward 
computer study, Spanish study or Spanish-speaking people showed 
no statistically significant difference between the groups 
or any significant change for the entire group at the conclusion 
of the study, with one Important exception: the post gain score 
showed an Increase In integrative motivation to learn Spanish for 
the group as a whole (Items #29-32). Various interpretations 
could account for this finding. Motivation to study Spanish may 
have been Increased by the novelty of the new mode of learning, 
particularly since the students were near the end of a year-long 
course In the same classroom. i?- *^ an opposite perspective, 
perhaps the total CAI environment, wuich lacked teacher Interven- 
tion and even audio or video facsimile, made students appreciate, 
by contrast, the Importance of learning the language to learn 
about Spanish-speaking people. Student comments regarding the 
Impersonality of the exclusively CAI medium could be Interpreted 
as support for the latter Interpretat lon» 

Open-ended questions, which could not be coded numerically 
and therefore were not submitted to statistical tests, did show 
some Interesting changes during the study. These findings will be 
discussed together with the opinions and observations that 
follow. 

9.3 Student opinions and staff observations 

Anthropologists and social scientists have long recognized 
the value of obtaining data through the observations of partici- 
pants (In this case, students? and participant-observers (In this 
case> staff) . In the anthropological 1 Iterature "observational 
data" constitutes an ethnographic approach to research, which 
lends valuable qualitative data unobtainable through quantitative 
measures (see Robinson 1985 for a detailed discussion of the 
role of ethnography In FL education). 
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In the present study, students were extensively Interviewed 
on videotape both in the computer lab and also in a classroom 
discussion session. Additionally, staff in attendance during the 
field study kept a log of dally student comments, to which they 
added their own observations. Finally, two other observers were 
also interviewed on videotape following one of the lessons: the 
Principal of Montera Junior High School, Mr. Jim Welsh, and the 
Senior Project Advisor, Prof. Wllga Rivers, Harvard University. 
(See Appendix G for transcripts of the latter interviews.) 
This observational data provided a more complete evaluation of 
the research project in particular and of computer-assisted 
language instruction in general. What follows are the combined 
opinions and observations from these various sources. 

9.3.1 Positive views 

(1) A forgiving tutor 

According to both student comments and staff observations, 
the computer appeared to be a patient and forgiving tutor, 
willing to repeat an explanation endlessly without becoming 
annoyed at a recurrent student mistake. One student commented: 

"It doesn't yell at me when I make a mistake or think I'm 
stupid. • 

(2) No self-fulfilling prophecies 

Similarly, the computer made no prejudicial assumptions 
about student abilities based on previous performance. Such 
assumptions tend to have a negative effect on student achieve- 
ment (Bloom, 1968). The computer treated all students the same, 
regardless of the reputations they might have brought In from 
other classes. 

(3) Self-pacing and Individualization 

Students and staff alike recognized the benefits of Individuali- 
zation and self-pacing; typical student comments: 

•It lets you go at your own speed, so you don't have to wait 
for other kids to read In the book and stuff like that.^ 

•A lot more attention Is paid to you. You're not Ignored... 
You're sitting right In front of the teacher." 

•It's like your own personal little class." 

The post background questionnaire showed that students' assess- 
ment of the value of computers for individualized Instruction 
Increased 9.4%. Staff also observed unique Individualized 
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learning strategies that students developed. One student secretly 
put what he thought to be little "cheat sheet notes" onto the 
disk drive to help him learn the words* Other students frequently 
called up the vocabulary helpscreens^ while still others memo- 
rized the vocabulary when initially Introduced. 

(4) Time on task 

Perhaps the most salient observation was the increased student 
concentration level and attention span while completing the CAI 
exercises^ In contrast to their classroom behavior. In the 
computer lab, students were continually on task: 

"One day during the study, we spent ten minutes with the 
group before class taking roll and playing Spanish word 
games. During this time, students were passing notes to 
one another, calling out to each other, and were generally 
rowdy, paying little attention to the teacher. A few 
minutes later, as soon as they sat down at the computers, 
there was an Immediate change In their demeanor. Two 
minutes into the lesson, faces were Intent upon what they 
were doing, they were quiet.. .the only sound In the class- 
room was the 'cl Ick-cl Ick-cl Ick' of the keyboards." 

(staff) 

Both the Principal and Senior Project Advisor were particularly 
Impressed by the motivational level the students showed, their 
intensity of Interest, and their time on task. 

"I was very excited to see the intensity of Interest the 
students were showing, and the way In which they seemed to 
be concentrating...! think one only had to see those 
students working to realize that they were enjoying what 
they were doing, and that Is the first step towards solving 
any educational problem." 

CRivers) 

The CAI experience had such initial appeal that one student asked 
her parents for a home computer so she could study Spanish In 
lieu of a trip to Hawallt While the Intensity of Initial enthu- 
siasm was in part due to the novelty or "Hawthorne effect," the 
increased time on task remained a consistent factor throughout. 

(5) Computer literacy 

In addition to the above benefits, the CAI experience "helped 
students become more computer literate" (Principal). In the post 
background questionnaire, this was also reflected In student 
comments. When asked to Indicate which aspects of computers they 
liked the most, students mentioned "ease of use" most often. 
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9. 3*2 Negative views 

(1) Inflexlbll Ity 

The most serious concern of students and staff was the | 
inflexibility of the programs* While a forgiving and patient 
tutor, the computer was also aa inflexible one, only accept* 
Ing responses exactly as anticipated. For example, one program 
only accepted "Los nlnos se duermen" I the children fall asleepl 
to describe a certain graphic, although "se acuestan" tthey go to 
bed] was another plausible, but rejected^ response. In another m 
program, students were told they were "wrong- when they pressed 
the space bar before an otherwise correct answer. 

(2) Novelty wears off 

By the second week of the project, the Hawthorne effect had | 
begun to diminish. Students commented they were bored when 
lessons turned out to be too short for the class time, suggesting 
that If there had been more material — but not just more of the 
same — their Interest might have continued. There was a difference 
observed between the experimental and control groups In this 
regard: students In the control group commented of boredom more ^ 
frequently. One student In the control group who heard his 
neighbor in the experimental group laughing complained: 

•Why did I get the boring one?- 

<3> Impersonalness ^ 

Perhaps even more Important, the computer was viewed as 
Increasingly Impersonal. When asked what they liked least 
about computers on the post background questionnaire, 24% of the 
students Indicated they felt computers were "Impersonal ma- 
chines". One student pointed out: ^ 

"I'd rather come to class and have a teacher and be able to 
discuss things." 
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9.3.3 Mixed opinions about graphics 

Students generally enjoyed the graphics (although the 
control group was sometimes envious of the experimental group and 
wondered why they got the boring pictures). An occasional problem 
arose because of the ambiguity of the graphics: what Is "under 
the tree" to one is "beside v;he tree" to another. Some students 
who had amber screens complained of the color, while others 
commented they wished the graphics were animated. While not 
within the scope of the present study, there clearly needs to 
to be further Investigation Into the varied effects of computer 
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graphics on achievement as well as on attitudes: color graphics 
vs* black and white, stationary vs* animated, etc* 



9*3*4 Conclusion 

In summary, students and staff alike found several advanta- 
ges to learning on a computer: It Is Interesting, challenging, 
self-paced, a bit like having their own private tutor, yet one 
that doesn't yell at them. At the same time, they were also 
aware of Its shortcomings: It tends to be Inflexible, and one 
can't ask It questions or discuss things with It* And of course, 
as one student pointed out. If they used them all the time In all 
of their classes, the novelty would soon wear off. 
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10 ACHIEVEMENT, APTITUDE AND ABILITIES 



10,1 Cumulative post achievement test gains 

Overall pre-post achievement gains clearly favor the 
experimental group. In absolute terms (bottom of Table 3);^ and 
when mediating factors such as prior knowledge and abilities are 
taken into account (Table 2), the experimental group consistently 
outperformed the control group; specifically, the experimental 
group's gain scores are significantly higher (♦OS level of 
significance or better) than the control group's scores when 
mediated for each of the following: 

0 Prior knowledge of Spanish (pre-achievemenl; scores) 

0 California Test of Basic Skills (CTBS) reading scores 

0 CTBS composite scores 

0 Pimsleur Language Aptitude Battery (PLAB) composite scores 

Due to the lack of any statistically significant differ- 
ences in gain scores for the control group over the experimental 
group, and the consistency of the results in favor of the 
experimental group, there is a high level of confidence that 
instructional treatments did favor the experimental group. This 
is especially true in view of the fact that pre- and post- 
achievement tests were identical, and were directly related to 
instructional goals* 

10«2 Post aptitude gains 

Although it is unlikely that one's ability to learn a 
language would change as the result of a nine-day project, 
a significant gain in pre-PLAB to post-PLAB vocabulary scores 
was noted for the experimental group (Table 3). It is interest- 
ing that, of the three PLAB subtests, it is the vocabulary test 
which is most closely related to memory factors. As discussed 
previously, the experimental hypotheses were based upon memory 
research and tied to memory factors. Since the particular 
PLAB vocabulary items had no relationship to the Spanish vocabu- 
lary taught in th(^ units, one might surmise that any gains in 
vocabulary-acquiring skills could be the result of developing or 
improving learning strategies through the experimental treat- 
ments. Other researchers may want to Investigate further the 
relationship between pedagogical treatments and language aptitude 
gains* 

10.3 Dally test results 

Not surpr lslngly# the differences between experimental and 
control groups on dally tests were less clear-cut than on the 
cumulative post tests. Without taking prior experience Into 
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account, there were no significant differences between groups on 
any day (with the exception of one of the three tests on day 7# 
resulting in balanced findings). However* previous experience 
must be taken into account to distinguish the effects of the 
Instructional treatments from what students already knew prior to 
the study. Therefore, the mediated results are of greater 
Interest. 

10. 3. I Answer-judging hypotheses 

When the daily tests were mediated by pre-achievement 
scores, a statistically important difference in means was found 
in favor of one answer- judging treatment on each of the Days 3, 
6, 8, and 10 (Table 5> • The results are consistent with the 
experimental answer-judging hypotheses on three out of the four 
test days: day 3 (student discovery), day 8 (student vs. program 
control), and day 10 (implicit vs. explicit feedback). On day 6a 
(recycling of missed items), the hypothesized second best 
treatment, immediate repetition of a parallel item, was favored 
over the hypothesized repetition of the same item at spaced 
intervals. 

Answer-judging groups scored as follows (groups are given 
in descending order according to daily test means): 



Day 3 (Ajl) - Student discovery: Groups 4, 2, 1, and 3. 

Group 4: Location of error with graded hints 

After both first and second mistrials, the program 
locates the error by blanking out the incorrect part of the 
corresponding sentence, then gives a hint to help out the student 
<"3he washes something but it isn't the sink."). The content of 
this hint varies according to which incorrect response the 
student has chosen. 

Group 2: Correct answer with explanation 

After the first mistrial, the program responds with 
"Wrong, try again." After the second mistrial, the correct 
answer is given, along with an explanatory comment such as "The 
verb cepillarse means to brush." 

Group t: Correct answer only 

After the first mistrial, the program responds with 
"Wrong, try again." After the second mistrial, the correct 
answer is given. 

Group 3: Location of error only 
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After the first mistrials the program Identifies the 
part of the student's answer which Is In error by display- 
ing the corresponding sentence with blank spaces for the wrong 
part. This routine is repeated after the second mistrial; then, 
following a pause, the correct answer is glven^ 

The findings clearly favor the use of a combination of 
location of error and hints over correct answer only or location 
of error alone. The differences between the other group means are 
too slight to draw conclusions from. However, these findings 
clearly support the hypothesis that strategies which guide 
students to discover the correct answer and understand why they 
made particular errors are more effective than those which do 
not* i 

Day 6a (AJ5> - Recycling of missed items: Groups 2, 3, 1, 4 

Group 2: Immediate repetition of parallel item 

A parallel item <same form, different context) is 
given following the second mistrial. 

Group 3: Repetition of missed items together at the end 

Missed Items are stored, then repeated at the end of 
the exercise. 

Group 1: Immediate repetition of same item 

The same item Is repeated immediately following the 
second mistrial. 

Group 4: Repetition of missed items at random intervals 

Missed Items are stored and repeated at random 
intervals during the exercise. 

The above results do not concur with the hypothesis that 
items repeated at random intervals will be more effective. In 
this instance the treatment that was predicted as second best, 
immediate repetition of parallel items, was favored. However, 
as discussed earlier, a parallel item may have allowed a sense of 
conceptual space, although the Item followed immediately. 
Also, given the short time span of each activity on this day, 
repetition of all items together at the end of each activity 
might have more accurately represented •spaced practice." The 
hypothesis was derived from social learning theory, in which 
spaced practice refers to practice of a similar behavior 
over time, i.e. over a number of training sessions, in increments 
of graduated difficulty. Perhaps a more appropriate application 
of this theory to FL learning for future research would be the 
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instruction and perfomance of slitllar linguistic tasks over a 
nuiber of training sessions* Based on the present £,tudy, one 
would expect the latter hypothesis to be confirmed* 

Day 8 <AJ3) - Program-controlled feedback vs. student controlled 
help: Groups 3^ Z, 4, 1 

Group 3: Combined program and student-controlled help 

After each mistrial, the student may try again without help 
or seek help by pressing the "escape" key. After the student 
requests help, the program automatically calls up the help screen 
pertinent to the particular error made, and allows the student to 
retype thr response* 

Group 2: Total progam-control led help 

After each mistrial the program automatically displays a 
help screen with hints related to the type of error the student 
has made; after consulting this screen,^ the student may try 
again. 

Group 4; Total student-controlled help 

After each mistrial the student may try again or seek help 
by pressing the "escape" key, which calls up a "help menu." Prom 
this menu students may then choose the type of help screen they 
feel they need — e.g. Do you want to review the vocabulary? the 
grammar? the story? etc. -- then retype the response. 

Group I: No help: programmed correct answer 

The program gives the correct answer and instructs the 
student to type It in again* 

These findings clearly support the hypothesis that a 
combination of both student control and program control is most 
effective. When students have total control as In Group 4> they 
may lack the expertise to diagnose their own errors and/or they 
may lose valuable time on task while considering the options 
available. In any case, the ranking of the "no help" Group I 
clearly suggests the need to make some sort of on-line help 
available to students. 



Day 10 (AJ4> - Implicit vs. explicit correction: Groups 2, 1 
Group 2 : Impl lei t 

On the first and second mistrials, the student's error Is 
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highlighted on the screen, and a question appears which Implicit- 
ly models the correct forxt In a communicative manner, such as: 

Program; What did he do? 
Student: He ifSiSfid 
Program: Who^dTd you say woke up? 
Student: (new response) 

On the third mistrial, the correct answer Is given. 

Group 1 (explicit): On the first mistrial, the student's 
error Is highlighted on the screen, followed by "No es correcto* 
Intenta otra vez." (That's not right, try again.) On the second 
mistrial, the correct answer Is expl ictly modeled and the 
student tries again; for example: 

Program; What did he do? 

Student: He waked up» 

Program: No. He woke up. Try again 

On the third mistrial, the correct answer is given again. 

The findings support the hypothesis that Implicit modelling 
of error correction within a communicative context Is more 
effective than explicit correction. Implicit modelling Is also 
akin to giving hints. In this regard, findings here further 
confirm the evidence in Day 3 of the value of using hints which 
guide students to discover their errors- 

10.3.2 Pedagogical hypotheses 

When the dally tests were mediated, results for the differ- 
ent pedagogical treatments were ambiguous • 

Most often, results balance out between the two or three 
tests on any given day. For example, when controlling for prior 
knowledge of Spanish, I.e., pre-achlevement scores, (Table 5) we 
find the experimental group slightly favored on day 4, le. at the 
•01 level of significance, the control group favored on Days 
2, 6b, and 7, and results on other days either balanced out 
across tests, or with no significant differences In any test. 
With other mediators, findings were equally ambiguous. Such 
inconsistent findings offer no evidence for rejecting the 
hypotheses. 

There are several interpretations possible for these 
apparently inconclusive findings, and the discrepancy between 
daily results and overall post results: 

(I) First, one must distinguish between short-term. 
Immediate recall actl vit les and longer-term, delayed recall 
activities. It is commonly pointed out that rote learning 
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activities and structural drills, while they nay be effective on 
a short-term basis, do not usually contribute to long-term 
retention (cf*> e*g*. Brown ld80>* It follows, then, that methods 
which might appear to be equally or even more effective imme- 
diately, in the short term, may actually prove to be less 
effective in the longer term. This would account for the 
differences between the daily results and the overall post gains 
shown by the two groups, since in fact the daily results were 
based on immediate recall tests and the overall results were 
based on delayed recall tests. 

(2> Similarly, although it was our intention to test both 
communicative competence (i.e., via the integrative tests) and 
linguistic competence (the discrete tests), the actual achieve- 
ment testing tended to measure linguistic competence more than 
communicative. In other words, as was pointed out earlier 
(Section 6.5), the distinction between "Integrative" and "dis- 
crete" tests tends to be blurred by short written tests given 
Immediately following Instruction which need to Include particu- 
lar structural and lexical Items* By definition, such tests, 
unlike proficiency tests, are tied to specific contexts and 
appear to tap similar linguistic factors, regardless of their 
orientation as Integrative or discrete. 

These tests were more similar to control group activities, 
which were generally much more manipulative. This would be 
especially true on day 7, In which the variable being measured 
was In fact meaningful practice vs. manipulative practice. Des- 
pite the latter similarity, the experimental group outperformed 
the control group on the cumulative post tests. 

(?) A further factor which may have confounded the results 
on the dally tests Is the distraction which may have resulted 
from certain experimental treatments. For example, the use of 
student-chosen names of movie stars In the Day 2 experimental 
exercise, or the problem-solving activities Involving unscram- 
bling pictures in Day 6b, may have had the short-term effect of 
distracting students from the task at hand, even while they were 
contributing to Increased retention In the longer term. 

<4) An additional factor mentioned earlier In the discus- 
sion of procedures was the number of times students were exposed 
to the lessons. As was pointed out In Section 6.4, students were 
required to turn In their data disks after completing the day's 
lesson the first time so as not to confound learning trials and 
dally test scores. Students would then normally run tlirough the 
lesson at least once more, after which they commented that they 
felt much more sure of their answers and wished that they could 
go back and change the data . (Researchers also observed a 
noticeable difference between the experimental and control groups 
In motivation the second time through: the experimental group 
tended to maintain more Interest than the control group, who 
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coiMented more often of boredom [see Section 8]), One likely 
effect of this practice, obviously. Is that overall scores would 
tend to show greater Improvement than dally scores, since by that 
time the material ho^d been covered more thoroughly ♦ Therefore, 
unlike the dally scores, the overall post scores represent the 
cumulative effects of having acquired the material through either 
the control or the experimental treatments ♦ 

10.4 Clustering of tests 

Tests were developed according to the categories of Integra- 
tive recall, <IR) Integrative production (IP), discrete recall 
<DR) and discrete production <DP> to Insure that the complete 
battery of tests would not be biased In favor of one treatment. 
Both groups took all tests. The discrete production and recall 
tests were thought to favor the control treatments, while an 
equal number of Integrative production and recall tests were 
thought to favor the experimental treatments. However* results of 
the cluster analyses of the tests themselves also showed a lack 
of distinction between the a priori categories of •integrative" 
and "discrete". That Is, student performance on daily achieve- 
ment tests did not generally differ depending on the type of 
test, regardless If they were In the experimental group, the 
control group, or viewed as one group. Only one out of five 
groups of tests scores actually clustered together according to 
the a priori categories. This finding suggests that the majority 
of tests tapped similar factors. The latter supports Carroll's 
notion that different tests eventually test a nucleus of know- 
ledge Involving vocabulary and grammar (Carroll, 1973). <8ee 
Table 7 for a listing of test clusters and description of the 
tests that did cluster.) 

10.5 Correlations between CTBS, PLAB and achievement 

Similarly, significant correlations found between CTBS and 
achievement, and the PLAB language analysis subtest and achieve- 
ment <see Correlation matrix. Table 6), also suggest that the 
tests in general tapped similar factors. That Is, all written 
language tests, regardless if of the IR, IP, DR, or DP type, may 
rely heavily upon reading and grammatical skills. In any event, 
this appeared to be the case regarding the particular tests used 
in this study. These correlations might also explain why the 
control group, whose methods more often reflected traditional 
reading and grammatical analysis (e.g. Day 7 In particular), 
outperformed the experimental group on Days 2, 6a, and 7. 
Control treatments were perhaps more consistent with the form of 
written testing; I.e., they tended to favor "test-takers." 
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11 CONCLUSION: IMPLICATIONS AND RECOMMENDATIONS 

Despite the apparent similarity of control activities and 
the tests, the experiiiental group still showed a clear advantage 
over the control group on dally test scores for most answer — 
Judging hypotheses and on the po5t cumulative gain scores, which 
covered all the material Introduced through the different 
pedagogical as well as answer-'j udging treatments. Given the 
overall higher gains of the experimental treatments (although not 
always disclosed on a dally basis), what do all of these hypo- 
theses have In common? 

11.1 The common denominators 

What all of these hypotheses have in common Is an emphasis 
on meanlngfulness and student discovery. The material must be 
meaningful both in the cognitive sense (how language relates to 
the world around us) and in the affective sense <how language 
relates to our Inner selves and the things we care about). 
Instructional activities and feedback strategies must also 
lead students to act I vely discover the material > allowing 
comprehension to take place (which is always related to past 
frame of reference and the active making of inferences). 

As discussed in the review of literature <Sec. 3), the 
emphasis on meaning and student discovery Is not new to the 
language teaching profession. Many language teaching theorists 
have been saying as much for years <cf. Stevick 1976> Krashen 
1981, Rivers 1964, 1981, Robinson 1981), and many approaches 
focusing on meaning have been developed. They are part of an 
overall philosophy of language teaching which is exemplified in 
the British communicative approach and in interactive language 
teaching where students use language constantly, with the 
teacher, with each other, and with the community that speaks the 
language to convey meanings of Importance to them (Rivers 1985). 

The present study offers empirical evidence in favor of such 
approaches which stress meanlngfulness and student discovery. 
Perhaps even more Important than confirming what language 
educators have already known, the particular contribution of the 
present study has been to isolate and define the ingredients that 
make up "meanlngfulness" and "discovery strategies". 

The six pedagogical hypotheses outlined In Section 4.1 can 
be summarized briefly as follows: Language learning material 
will be more effective if It is presented and EEa£li££^ 
Integrated context (PI) In which students' attention Is focused 
on the meaning of the material (P2) and language is used to draw 
inferences, as In solving a problem (P6). Furthermore, students 
should be able to relate personally to this material, either 
because It contains reference to themselves or to people they 

42 



48 



ERLC 



know <P3>, because it Is amusing or otherwise ewotionally 
appealing to them (P4), or because it is material vhich they 
select out of personal Interest <P5), 

The four answer- j udging hypotheses outlined in Section 4,2 
may be summarized briefly as follows: Feedback to the student 
when a mistake Is made Is more effective If, Instead of merely 
displaying the correct answer, errors are located by highlighting 
or by blanking out wrong characters at the same time students are 
led to discover the correct answers by means of graded hints 
(AJl), or the question Is rephrased to offer Implicit correction 
through modeling within a meaningful context (AJ4) • It Is 
Important to stress that "leading" students to "discover" 
requires combining expertise of the teacher or program author 
with student control of the process, such as the combination of 
student-controlled help and programmed-controlled feedback that 
was found to be the most effective form of help (AJ3>» Further- 
more, It would appear that missed Items might most effectively be 
followed by a parallel Item so that the student may apply 
reasoning to a new Instance of the problem rather than being 
forced to mindlessly type In the same Item <AJ5). "Wrong, try 
again", followed by correct answers, lends little help In guiding 
students to discover answers* 

Together, the above principles and feedback strategies may 
be viewed as a generic checklist for the successful organization 
of materials. 

Of equal I importance Is what was learned from student 
opinions, staff observations and piloting. The computer can be a 
valuable tool: It challenges students and encourages them to 
develop their own learning strategies, while proceeding at their 
own pace; It Is also a forgiving and patient private tutor. But 
at the same time It Is a mechanical. Impersonal and Inflexible 
tutor, accepting student responses only exactly as anticipated. 
Piloting materials helps to Identify mechanical problems (bugs). 
Inflexibility ("user-unfrlendl Iness") and pedagogical problems 
(content appropriateness In terms of amount of time, level of 
dl f f Iculty , clarity of Instructions and Interest, ) Student 
Interest surveys also help to develop programs which are motiva- 
ting. However, the Impersonal quality of computer instruction 
can only be remedied by balancing CAI with the human element: 
ensuring that CAI Is an Integral rather than separate component 
of the total program of Instruction, and that teachers are 
likewise an Integral part of the CAI laboratory. 

By applying the above principles, feedback strategies and 
research techniques, the profession may come one siep closer to 
understanding just how the aim of communication may effectively 
be achieved In texts as well as In computer software. 
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IU2 Recommendations for further research 

Needlesss to say> there are other hypotheses pertaining 
I to FL pedagogy and CAI worthy of research which were not possible 

to include within this one-year project* 



Pore ign language pedagogy 

t) In the area of FL pedagogy, other researchers may wish to 

examine further the issue of personal meaning. The present study 
compared the relative effectiveness of using material containing 
known others (singer or actor chosen by the student) with 
material referring to anonymous others of the traditional Juan 
and Maria type. It would be useful to carry this study further 

I by investigating the relative effectiveness of material based on 

self -ref erence (hence with a high affective level) with material 
based only on word definitions (low affective level) • 

While the present study also compared Integrated with 
non- integrated exercises, and communicative with manipulative 
I drills, other studies may wish to examine the use of exercises 

developed around notions and functions compared with other 
formats • Testing of a not lonal /functional hypothesis would 
require a longer field study than that of the present project. 



Computer capabllltes: dialogue branching; audio/video Interface 

The present study also compared the relative effectiveness 
of allowing students to choose story topics from a menu with 
assigned stories. This hypothesis Is related to the theory that 
comprehension relies heavily upon what the learner already 
knows. In a similar fashion, one could hypothesize that 
student-controlled dialogue branching would also be more effec- 
tive than pre-set program-assigned dialogues. (Dialogue branching 
was ruled out as Impractical In the present study due to the 
language level of the field study population and the programming 
time required.) 

Future researchers may wish to examine the effects of audio 
and video Interface on achievement and proficiency. Are they cost 
effective? Mot Ivatlonally effective? In addition to the effects 
of these media on achievement and proficiency, what Is their 
effect on user attitudes toward speakers of the language? 



Longer-term studies for proficiency testing 

Research over a longer period of time will be needed to 
assess the relationship between different pedagogical strategies. 
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Including CAI strategies^ and overall language proficiency. The 
present study clearly showed the differences between short-term 
dally achievement results and overall cumulative achievement 
results. While the former tests may Indeed measure dally achieve- 
ment with respect to particular linguistic goals^ such measures 
are not Indicative of overall cumulative achievement gains, which 
are of greater Interest to language educators* Of even greater 
Interest are changes In student prof Iclency . Since language 
proficiency measures are not sensitive enough to Identify change 
within a two-week instructional period, longer-term field studies 
are needed* 



CAI In the instructional program: the need for a synthesis 

The findings of the present study, as we have seen, have 
clear Implications for foreign language teaching both In the 
classroom and through the use of the computer. What Is needed at 
this point Is a well-formulated synthesis of the two. We need to 
develop complete Instructional programs which selectively 
Integrate those pedagogical principles and feedback strategies 
which have now been shown to be most effective. Where computers 
are used, every effort should be made to use them In ways which 
are consistent with the overall goals of the language course. 
This may mean rejecting or discarding courseware based on 
principles which are alien to those of the course. Certainly It 
should Include an effort on the part of language teachers, 
administrators, and materials developers to find new and more 
appropriate ways of Integrating CAI Into the classroom curricu- 
lum. The next step will be to Incorporate audio and video 
components, where possible, to provide a richer and more authen- 
tic communicative environment, although this was not Investigated 
In this study. Only when such efforts have been made can we 
fairly Judge the true educational potential of the technology 
which confronts us. 
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TABLES 



TABLE 1 

Student Characteristics by fissioned Group 



Control Experimental N Missing 



Answer Judging Group: 


1 


a 


3 


4 






Sex 


Boys 


16 


10 


14 


10 


50 






uir X 5 


6 


10 


6 


11 


33 




















Grade 


7 


1 


4 


0 


0 


5 






8 


o 


/ 


5 


S 


£0 






9 


17 


9 


15 


18 


57 


1 


Teacher 


1 


16 


12 


13 


IS 


53 








3 


5 


4 


9 


21 






• 












9 


Can Type? 


Yes 


14 


13 


14 


14 


55 






No 


5 


4 


3 


7 


19 




How Long Have You 














9 


Been Typing? 
















(Average Months) 


1 


33 


40 


25 


49 
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TABLE g 

Analysis of Covariance on flchievewent Test Gain Scores 
Means and Proability Values with Various Covariates 



Covariate N Control Experimental 

(Exp/Cntrl) Mean Mean P Group* 



None AS/37 
flchievenient 

Pretest AS/37 

CTBS Composite 

Language 35/33 

CTBS Reading 35/33 

Interest in 

Learning Spanish 3B/35 
Enjoyment of 

Spanish Class 3S/35 

Pimsleur Pretests 

Composite Score A 1/36 



30.81 

20.81 

32.91 
33. 11 

32.44 

32. 44 

31. 12 



34. 43 

34.43 

35.27 
35. 27 

34.54 

34.54 

33.69 



0.32 

> 0.01 (e) 

) 0.05 (e) 
) 0.03 (e) 

0. 51 

0. 76 

) 0.02 (e) 



Note: Each of the above variables was found to be related to Gain scores. 
See Table of Intercorrelations, Appendix fl. 

P values preceeded by ' > » are judged significant. 

» Letter in parens indicates group with higher mean; c=Control, e=Experi- 
mental . 
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Table 3 



Test Means and T-Test 
Probability Values 



TEST («, SCALE, 
NUMBER OF ITEMS) 



N ■ 
(CNTL/EXP) 



CONTROL 
Mean 



EXPERIMENTAL 
Mean 



P» Groupl 



CTBS Composite 

Language 35/36 

CTBS Reading 35/36 

Pirasleur (Pretest) 

Language Analysis 41/40 

Sound/Symbol Assoc 41/40 

Sound Discrim. 41/40 

Vocabulary 41/40 

Composite 41/40 

Pimsleur (Posttest) 

Language Analysis 40/34 

Sound/Symbol Assoc. 40/34 

Sound Discrim. 40/34 

Vocabulary 40/34 

Composite 40/34 

Pirnsleur Gains 
(Posttest-Pretest ) 

Language Analysis 39/34 

Sound/Symbol Assoc. 39/34 

Sound Discrim. 39/34 

Vocabulary 39/34 

Composite 39/34 



81. 8 
78. SS 



9.02 
18.88 
18.00 
12.83 
58.73 



10.02 
19.72 
17.80 
12.97 
60.52 



1.00 
0.82 
0. 18 
0.44 
2.44 



85. 86 
79. 69 



9. 35 
19.75 
17.97 
13. 62 
60.70 



10.26 
20.50 
18. 97 
15. 55 
65. 29 



1.00 
0.85 
1.06 
2. 15 
5. 06 



0. 33 
0.84 



0. 65 
0.24 
0.98 
0. 42 
0.41 



0.79 
0.29 
0.36 
0.02 (e) 
0. 10 



1.00 
0. 96 
0.40 
> 0.02 (e) 
0. 12 



flchievement Tests ; 

Pretest Composite 
Postest Composite 

Gain 

(Posttest-Pretest ) 



42/37 
42/41 

4S/37 



75.81 
106. 62 

30.81 



72. 92 
107. 46 

34.43 



0.57 
0. 85 

0. 32 



* Tests for unequal variances, were performed in each case. When variances 
appeared unequal, reported P values are adjusted. 

CTBS Composite Language and Reading scores were taken from student records. 

^' Ldii^^!/'"^'^^'^^?.J^u'.^' ^""^ ^"'^aed significant. Letter in parens 
indicates group with higher mean; c=Control, e=Experimental. 
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Classil j,cation^of_Daj,lj:_Testsi 
Number^of^Tests^IlYBes^ 



DAY 


TEST NUMBER 


TEST TYPE 


NUMBER OF 


2 


Test 1 


IR 


< 10) 


2 


Test 2 


IP 


(5) 




1 e s o 


T R 


(5) 


4 


Test 1 


IR 


(10) 


H 


i e S U A 


TP 




A 
H 




TP 


(7) 


5 


Test I 


DR 


(5) 


5 


Test 2 


IR 


(5) 


5 


Test 3 




(9) 


6 


Test 2 


IR 


(7) 


6 


Test 3 


DP 


(5) 


7 


Test 1 


DP 


(10) 


7 


Test 2 


IP 


(5) 


9 


Test 1 


None 


(12) 


9 


Test 2 


DR 


<5) 



ANSWER JUDGING BLOCKS: 



3 


Test I 


DR 


(6) 


3 


Test 2 


IR 


(7) 


6 


Test I 


IP 


(6) 


8 


Test 1 


IP 


(8) 


8 


Test 2 


DP 


(5) 


10 


Test 1 


IR 


(6) 


10 


Test 2 


DP 


(18) 
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TQDLE 5 

Analysis of Covari; ^nce on n^ily Test Mpavng 
Experirng ntal vs. Control Gy*Qnp g - 
flchieverngni: Prefcest ac; Co'yariafcp 



DAY 


TEST («, SCALE, Kl' 
NUMBER OF ITEMS) (CNTL/EXP) 


CONTROL 
Mean 


a 
a 
a- 


Test 1: IR (10) 
Test 2: IP (5) 
Test 3: IR (5> 


35/35 
34/34 
34/29 


8. 11 
3.06 
4.41 




4 
4 
4 


Test 1: IR (10) 
Test 2: IR (S) 
Test 3: IP (7> 


35/32 
34/32 
34/32 


9.23 
3.82 
6.5i5 




5 
S 


Test 1: DR (5) 
Test 2: IR (5) 
Test 3: (9) 


38/34 
38/34 
38/34 


4. 47 
3.74 
4. 79 




e 

6 


Test 2: IR (7) 
Test 3: DP (5) 


26/28 
36/28 


3. 64 
3.44 




7 
7 


Test 1: DP (10) 
Test 2: IP (5) 


36/35 
35/55 


6. 19 
3.78- 




9 
9 


Test 1: None (12) 37/34 
Test 2: DR (5) 37/34 


8. £2 
3. 97 




OMSUER jiinRTMR p, nrK^- 


Group 

1 


Group 
2 






N1/N2/N3/N4 


3 
3 


Test 1: DR (6) 
Test S: IR (7) 


22/16/13/20 
22/16/13/20 


5.59 
5.27 


5.87 
5.62 


6 


Test 1: IP (s) 


20/16/10/18 


3.45 


3.81 


8 
8 


Test 1: IP (e) 
Test 2: DP (5) 


21/16/16/17 
19/16/15/17 


4.57 
3.68 


5. 44 
4. 12 


10 
10 


Test 1: IR (5) 
Test 2: DP (18> 


34/32 
33/32 


4.06 
11.39 


4.09 
11.75 



EXPERIMENTAL 

Mean P ^ Group' 



7.94 
2.68 
4.41 

9.19 
3.97 
6.28 

4.47 
3.97 

4; 12 

3.61 
3. 12 

5. n 
2.57 

8.47 
3.82 



> 0.01 (c) 

> 0.01 (c) 
0.34 

> 0.02 (c) 

> 0.01- (b) 
0. 63 

0.25 
} 0.01 (e) 

> 0.01 (c) 

> 0.02 (c) 

> 0.01 (c) 

> 0.01 (c) 

> 0.01 (c) 

> 0.01 (e) 

> 0.01 (c) . 

(1) 



5. 77 5. 65 0. 86 

5.23 "5.70 > 0. 01(e) 

3.50 3.06 ) 0.01 

5.52 4.94 > 0.05(e) 

3.07 3.94 . 0.42. 

---- > 0.02(e) 

) 0.01(e) 



ERIC 



N3TES 

I P values preoeeded by ■ ■ are judged signifloant . 

' eSJSeSr^"*''^^'^ Of difference, c=Oo„tro.; • 

' taportS;ttlen;rln?uZr^aS' ~ imagine treatments showed 
pairwise oompSrtes?s lS^^<f 'l"?"''^'"^ WMle multiple : 

the numeri JoSordifSnoe?beSrt,f"°"^'' the differences „ 

agreement with the expSStT?,^^Ss*n Ta^r^^a'S 7^ ^" 

" 65 ' 



CORRELATION COEFFICIENTS / PROS > |r| UNDER HO:RHO=0 / NUMBER OF OBSERVATIONS 



02TSri 02TST2 02TST3 D3TST1 D3TST2 D4TST1 04TST2 D4TST3 05TST1 05TST2 



CO 



CTBCMP 

CTBS TOTAL LANGUAGE PERCENT? LE SCORE 



CTBRD 

CTDS REAOING PERCENTILE SCORE 



Q9 



66 



INTEREST IN COMPUTERS 



Q15 

ENJOYMENT OF SPANISH 



Q14 

INTEREST IN LEARNING SPANISH 



ACHCOMP 

PRETEST COMPOSITE SCORE TST1-TST12 



PACHIOMP 

POST COMPOSITE SCORE PTSTl~PTSTl2 



GAIN 

POSTTEST COMP - PRETEST COMP 



COMP 

PIMSLEUR COMPOSITE ON PRE TEST 



LriGAMAL 

PIMSLEUR LANGUAGE ANALYSIS SCALE - PRE 



SSASSOC 

PIMS. SOUUD-SYMBOL ASSOC. SCALE - PRE 



SUOISCR 

PIMSLEUR SOUNO DI SCRIM SCALE - PRE 



VOCAB 

-> PIMSLEUR VOCABULARY SCALE - PRE 



0.3B569 
0.0020 
52 

0.2B320 
0.0257 
62 

-0. 102M 
0.4 182 

65 

0. 194B3 
0. 1 199 

65 

0.34070 
0.0055 
65 

0.49055 
0.0001 
70 

0.65 490 
0.0001 
72 

0. 1374B 
0.25G4 
70 

0.26922 
0.0242 
70 

0.29B17 
0.0122 
70 

0.0275B 
O.B207 
70 

0.26092 
0.0291 
70 

0. 17309 
0. 1519 
70 



0.3757B 
0.0031 
60 

0.27372 
0.0343 
60 

-0. 17712 
0. 1649 
63 

0.27397 
a.029B 
63 

0.35132 
0.004B 
63 

0.43G9B 
0.0002 
6B 

0.60641 
0.0001 
70 

0. 15B53 
0. 19G6 
6B 

0. 19907 
0. 1010 
G9 

0.32025 
0.0073 
G9 

0.04002 
0.7440 
69 

0.09950 
0.4159 
69 

0. 13140 
0.2B1B 
69 



0.29325 
0.029B 
55 

0.27594 
0.0414 
55 

0. 12419 
0.3530 
5B 

0.054.76 
0.6831 
5B 

0. 14 109 
0.290B 
5B 

0. 1B66B 
0". 1429 
63 

0.30571 
0.0133 
65 

0.07054 
0.5B2B 
63 

0.21306 
0.0910 
64 

0. 1351B 
0.2B69 
64 

0.014BB 
0.9071 
64 

0.244B5 
0.0512 
64 

0. 19251 
0. 1275 
64 



0. 14122 
0. 2696 
63 

0.05517 
0.6676 
63 

0.32620 
0.0075 
66 

■0.06512 
0.6034 
66 

-0.20131 
0. 1051 
66 

0.04053 
0.7372 
71 

0.0130B 
0.9126 
73 

-0.02962 
0.B063 
71 

-0.00063 
0.9959 
71 

-0.23490 
0.04B6 
71 

0.09077 
0.4515 
71 

0.05B00 
0.6309 
71 

0.04590 
0.703B 
71 



0.50272 
0.0001 
63 

0.3 1644 
0.0115 
63 

-0. 1B279 
0. 141B 
66 

0.20301 
0. 1021 
66 

0.3 1320 
0.010^ 
66 

0.43525 
0.0001 
71 

0.62B99 
0.0001 
73 

0.15112 
0.20B4 
71 

0.31427 
0.0076 
71 

0.3B742 
O.OOOB 
71 

0.09953 
0.4009 
71 

0.25305 
0.0332 
71 

0. 16714 
0. 1636 
71 



0.31276 
0.0150 
60 

0. 19600 
0. 1334 
60 

-0.25950 
0.0434 
61 

0,24727 
0.0547 
61 

0.44179 
0.0004 
61 

0.33B95 
0.0050 
67 

0.70705 
0.0001 
69 

0.40252 
0.0007 
67 

0.276B6 
0.0233 
6V 

0.39101 
0.001 1 
67 

0.0502B 
0.6B61 
67 

0.2B509 
0.0194 
67 

0.0704B 
0.&709 
67 



0.36553 
0.0044 
59 

0.299B9 
0.0210 
59 

-0.2891 1 
0.023B 
61 

0.31610 
0.0131 
61 

0.49197 
0.0001 
61 

0.36477 
0.0026 
66 

0.69B35 
0.0001 
6B 

0.3B21B 
0.0015 
66 

0.25953 
0.0353 
66 

0.424B4 
0.0004 
66 

0.07696 
0.5391 
66 

0.22B09 
0.0655 
66 

0.0347B 
0.7B16 
66 



0.212B5 
0. 1055 
59 

0.24 600 
0.0604 
59 

-0.00BB5 
0.9460 
61 

0. 145B5 
0.2621 
61 

0.22320 
0.0B3B 
61 

0.00903 
0.9427 
66 

0.25525 
0.0357 
68 

0.255 13 
0.03B7 
66 

0. 11965 
0.33B6 
66 

0. 24755 
0.0451 
66 

0.05413 
0.6660 
66 

0. 14901 
0.2324 
66 

-0.07572 
0.5457 
66 



0.50532 
0.0001 
64 

0.49401 
0.0001 
64 

0.03030 
0.8077 
67 

0. 1091B 
0.3791 
67 

0.2295B 
0.0616 
67 

0. 19693 
0.0973 
72 

0.4477 1 
0.0001 
74 

0.2B677 
0.0146 
72 

0. 15199 
0. 1993 
73 

0.26791 
0.0219 
73 

0.09633 
0.4175 
73 

0.04414 
0.710B 
73 

0.05715 
0.6311 
73 



0. 16772 
0. 1B53 
64 

0.05550 
0.6631 
64 

-0.07590 
0.54)6 
67 

0.34319 
0.0045 
67 

0.39324 
0.0010 
67 

0.3599B 
0.0019 
72 

0.55177 
0.0001 
74 

0.2568B 
0.0294 
72 

0.02290 
" 0.B475 
73 

0.07763 
0.5139 
73 

-0.07997 
0.5013 
73 

0.05255 
0.6588 
73 

0.00963 
0.9355 
73 



o 



> 
w 
r 
m 
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CORRELATION COEFFICIENTS / PROB > |r| UNDER HO;RHO=0 / NUMBER OF OBSERVATIONS 



o 





05TST3 


D6TSTI 


D6TST2 


D6TST3 


CTOCMP 

CT8S TOTAL LANGUAGE PERCENTILE SCORE 


0.26019 
0.0249 
64 


0.21634 
0. 1060 
57 


0.34512 
0.0092 
56 


0.32661 
0.0140 
56 


CTBRO 

CTBS READING PERCENTILE SCORE 


0.26559 
0.0339 
64 


0.33319 
0.0113 
57 


0.31831 
0.0168 
56 


0.40854 
0.0018 
56 


09 

INTEREST IN COMPUTERS 


-0. 11945 
0.3356 
67 


-0. 17890 
0. 1752 
59 


-0.23715 
0.0705 
59 


-0.23002 
0.0797 
59 



D7TST1 D7TST2 D8TST1 08TST2 09TST1 



015 

ENJOYMENT OF SPANISH 
014 

INTEREST IN LEARNING SPANISH 
ACHCOMP 

PRETEST COMPOSITE SCORE TST1-TST12 



P ACHCOMP 

POST COMPOSITE SCORE PTSTI-PTSTI2 



GAIN 

POSTTEST COMP - PRETEST COMP 



COMP 

PIMSLEUR COMPOSITE ON PRE TEST 



LNGANAL 

PIMSLEUR LANGUAGE ANALYSIS SCALE - PRE 



SSASSOC 

PIMS. SOUND-SYMBOL ASSOC. SCALE - PRE 



SNDISCR 

PIMSLEUR SOUND DISCRIM SCALE - PRE 



V0CA8 

PIMSLEUR VOCABULARY SCALE - PRE 



0.36239 
0.0026 
67 

0.38635 
0.0012 
67 

0.4IB63 
0.0003 
72 

0.66536 
0.0001 
74 

0.26672 
0.0235 
72 

0.33381 
0.0039 
73 

0.42324 
0.0002 
73 

0. 16866 
0. 1537 
73 

0.24249 
0 0387 
73 

0. 13884 
0.2414 
73 



0.39970 
0.0017 
59 

0.41978 
0.0009 
59 

0.47299 
0 . 000 1 

64 

0.63240 
0.0001 
66 

0.09787 
0.4417 
64 

0.38241 
0 . 00 1 5 
66 

0.40508 
0.0007 
66 

0. 21006 
0 . 0905 
66 

0. 28158 
0.0220 
66 

0.20727 
0.0949 
66 



0.29566 
0.0230 
59 

0.25099 
0.0552 
59 

0.35B96 
0.0036 
64 

0.60497 
0.0001 

65 

0.231 17 
0.0661 
64 

0.31063 
0.0097 
65 

0.39374 
0.0012 
65 

0.10924 
0.3863 
65 

0.21682 
0.0828 
65 

0.20157 
0. 1074 
65 



0.31957 
0.0136 
59 

0.33009 
0.0107 
59 

0.41018 
0.0008 
. . 64 

0.66232 
0.0001 
65 

0.22553 
0.0732 
64 

0.35678 
0.0035 
65 

0.33636 
0.0062 

65 

0.27000 
0.0296 
65 

0.29477 
0.0171 
65 

0. 13598 
0.2801 
65 



0.38348 
0.0016 
65 

0.31742 
0.0100 
65 

-0, 24106 
0.0494 
67 

0.28245 
0.0206 

67 

0.38085 
0.0015 
67 

0.45575 
0 . 000 1 
71 

0.76162 
0.0001 
74 

0.32249 
0.0061 
71 

0.50546 
0.0001 
73 

0.36717 
0.0014 
73 

0.35575 
0.0015 
73 

0.47B16 
0.0001 
73 

0.22532 
0.0553 
73 



0. 19494 
0. 1197 
65 

0.24751 
0.0468 
65 

-0.07674 
0.5371 
67 

0.42666 
0 . 0003 
67 

0.36288 
0 . 0025 
67 

0.42640 
0.0002 
71 

0.64690 
0.0001 
74 

0.20672 
0.0837 
71 

0.35790 
0.0019 
73 

0.32961 
0.0044 
73 

0. 12240 
0.3023 
73 

0.38226 
0.0008 
73 

0. 171 19 
^ 0. 1476 
73 



0.46344 
0 . 000 1 

63 

0.55742 
0 . 000 1 
63 

-0. 24893 
0.0455 
65 

0.31637 
0.0102 
65 

0.36030 
0.0032 
65 

0.34124 
0.0038 
70 

0.67774 
0.0001 
73 

0.35689 
0.0024 
70 

0.45492 
0.0001 
71 

0.43416 
0.0002 
71 

0.30216 
0.0104 
71 

0.29130 
0.0137 
71 

0.28608 
0.0156 
71 



0.28718 
0.0248 
61 

0.38 601 
0.0021 
61 

-0. 1 1769 
0.3623 
62 

0.13230 
0.3053 
62 

0.10185 
0.4309 
62 

0.01806 
0.8846 
67 

0.28352 
0.0174 
70 

0.28744 
0.0183 
67 

0.27124 
0.0242 
69 

0.24081 
0.0462 
69 

0.22269 
0.0659 
69 

0.09776 
0.4242 
69 

0.22328 
0.0652 
69 



0.23161 
0.0653 
64 

0. 1 1216 
0.3776 
64 

-0. 1 1348 
0.3605 
67 

0.24705 
0.0439 
67 

0.36291 
0.0014 
67 

0.36940 
0.0015 
71 

0.576G5 
0.0001 
74 

0.21080 
0.0776 
71 

0.10327 
0.3880 
72 

0*27404 
0.0198 
72 

-0.04218 
0.7250 
72 

0. 13687 
0.2516 
72 

-0.04901 
0.6827 
72 



D9TST2 

0.02806 
0.8256 
64 

-0.06155 
0.6290 
64 

0.08443 
0.4970 
67 

0.34614 
0.0041 
67 

0.37267 
0.0019 
67 

0.40424 
0.0005 
71 

0.47687 
0.0001 
74 

0.02310 
0.8483 
71 

0.06942 
0.5623 
72 

0.1 1882 
0.3202 
72 

0.04232 
0.7241 
72 

0.24771 
0.0359 
72 

-0. 19085 
0.1083 
72 
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CORRELATION COEFFICIENTS / PROQ > |r| UNDER H0:RHO=0 / NUMBER OF OBSERVATIONS 





DlOTSTl 


010TST2 


ACHCOMP 


CTBCMP 


0. 


21216 


0.31474 


0. 17661 


CT0S TOTAL LANGUAGE PERCENTILE SCORE 


0 


.0978 


0.0135 


0. 1492 






62 


61 


60 


CTBRD 


0. 


1 1357 


0. 19934 


0. 1 1271 


CTBS READING PERCENTILE SCORE 


0 


.3035 


0. 1268 


0.3601 






61 


60 


66 


09 


-0. 


14753 


-0.27840 


0.06926 


INTEREST IN COMPUTERS 


0 


.2447 


0.0271 


0.5660 






64 


63 


71 



Q15 

ENJOYMENT OF SPANISH 



014 



INTEREST IN LEARNING SPANISH 



ACHCOMP 

PRETEST COMPOSITE SCORE TST1-TST12 

H-* PACHCOMP 

POST COMPOSITE SCORE PTST1-PTSri2 



GAIN 

POSTTEST COMP - PRETEST COMP 



COMP 

PIMSLEUR COMPOSITE ON PRE TEST 



LNGANAL 

PIMSLEUR LANGUAGE ANALYSIS SCALE - PRE 



ssassoc 

pims. sound-symdol assoc. scale - pre 



SNOISCR 

PIMSLEUR SOUND DI SCRIM SCALE - PRE 



VOCAB 

PIMSLEUR VOCABULARY SCALE - PRE 



0. 1 7897 


0.27689 


0. 1571 


0.0200 


64 


63 


0.27525 


0.38604 


0. 0277 


0 . 00 18 




63 


0.34402 


0.46812 


0 . 0047 


0 . 000 1 


bo 


65 


0.4 1 237 


0.71474 


0.O004 


0.0001 


69 


60 


0.06506 


0.29064 


0.4970 


0.0188 


66 


65 


0.03024 


0.31803 


0.8066 


0.0082 


68 


68 


0. 10601 


0.42521 


0.3896 


C.0003 


6& 


68 


-0.03872 


0.20195 


0.7539 


0.0986 


68 


60 


0.30063 


0.32901 


0.0 104 


0.0062' 


60 


68 


-0.26161 


0.01489 


0.0312 


0.9041 


60 


68 



0.47564 
0.0001 
71 

0.38274 
0.0010 
71 

1 .00000 
0.0000 
79 

0.7 1800 
0.0001 
79 

-0.45697 
0.0001 
79 

-0.02037 
0.6604 
77 

0. 10410 
0.3676 
77 

-0.05829 
0. 6 146 
77 

0.01710 
0.QQ27 
77 

-0.09537 
0.4093 
77 



PACHCOMP 

0.39700 
0.0006 
71 

0.35993 
0.0020 
71 

-0. 16869 
0. 1508 
74 

0.50165 
0.0001 
74 

0.51741 
0.0001 
74 

0. 7 *aoc 

0.U001 
. . 79 

1.00000 
0.0000 
03 

0.29102 
0.0093 
79 

0.25204 
0.0232 
81 

0.31073 
0.0037 
81 

0.09707 
0.3887 
01 

0.21208 
0.0564 
01 

0.09602 
0.3938 
81 



COMP LNGANAL SSASSOC SNOISCR 



0.46047 
0.0001 
70 

0.58150 
0.0001 
70 

-0. 1 5740 
0. 1835 
73 

-0.04916 
0.6796 
73 

-0.05182 
0. 6633 
73 

-0.0 2037 
0.6604 
77 

0.25204 
0.0232 

8; 

0.33429 
0.0030 
77 

1.00000 
0.0000 
61 

0.70552 
0.0001 
81 

0.69225 
0.0001 
81 

0.68439 
C.0001 
81 

0.71661 
0.0001 
81 



0.36550 
0.0019 
70 

0.48960 
0.0001 
70 

-0. 11637 
0.3268 
73 

0.04213 
0,7234 
73 

0. 13928 
0.2399 
73 

0. 104 10 
0.3676 
77 

0.31873 
0.0037 
81 

0.25807 
0.0234 
77 

0.70552 
0.0001 
81 

1 .00000 
0.0000 
81 

0.31097 
0.0047 
01 

0.35392 
0 . 00 1 2 
01 

0.39765 
0.0002 
01 



0.37828 
0.0012 
70 

0.36877 
0.0017 
70 

-0.25827 
0.0274 
73 

-0.06612 
0.5783 
73 

-0. 18517 
0. 1168 
73 

-0.05829 
0.6146 
77 

0.09707 
0.3807 
81 

0.24073 
0.0350 
77 

0.69225 
0.0001 
01 

0.31097 
0.0047 
01 

1 .00000 
0.0000 
81 

0.32794 
0.0028 
01 

0.37262 
0.0006 
01 



0.29728 
0.0124 
70 

0.22809 
0.0576 
70 

-0,05178 
0.6635 
73 

-0.03200 
0.7881 
73 

0. 10793 
0.3634 
73 

0.01710 
0.0827 
7/ 

0.21288 
0.0564 
81 

0. 10889 
0.0999 
77 

0.60439 
0,0001 
81 

0.35392 
0.0012 
81 

0.32794 
0.0028 
81 

1 .00000 
0.0000 
81 

0. 17320 
0.1219 
01 



VOCAB 

0.24183 
0.0437 
70 

0.48628 
0.0001 
70 

-0.04342 
0.7153 
73 

-0,06557 
0.5815 
73 

-0. 18812 
0.1110 
73 

-0.09537 
0.4093 
77 

0.09602 
0.3938 
81 

0.25418 
0,0257 
77 

0,71661 
0.0001 
81 

0.39765 
0.0002 
81 

0.3>262 
0.0006 
81 

0. 17328 
0.1219 
01 

1 .00000 
0.0000 
01 



GAIN 

0.29295 
0.0153 
68 

0,31215 
0.0096 
68 

-0.29247 
0.0133 
71 

0.05685 
0.6377 
71 

0. 12705 
0.291 I 
71 

-0.45697 
0.0001 
79 

0.29102 
0.0093 
79 

1.00000 
0,0000 
79 

0,33429 
0.0030 
77 

0.25807 
0.0234 
77 

0.24073 
0.0350 
77 

0. 18869 
0.0999 
77 

0.25418 
0.0257 



ERIC 



CORRELATION COEFFICIENTS / PR08 > |r| UNDER HO:RHO=0 / NUMBER OF OBSERVATIONS 





CTBCMP 


CTBRO 


Q9 


QI4 


CTBCMP 

CTBS TOTAL LANGUAGE PERCENTILE SCORE 


1 .00000 
0.0000 
71 


0.74155 
0.0001 
70 


-0.04840 
0.7013 
65 


0.06357 
0.6149 
65 


CTBRD 

CTBS READING PERCENTILE SCORE 


0.74155 
0.0001 
70 


1 .00000 
0.0000 
71 


0.01879 
0.8828 
64 


-0.00282 
0.9824 
64 


Q9 

INTEREST IN COMPUTERS 


-0.04B4B 
0.7013 
65 


0.01879 
0.8828 
64 


1.00000 • 
0.0000 
74 


-0.00045 
0.9970 
74 


Q15 

ENJOYMENT OF SPANISH 


0.02439 
0.847 1 
65 


0.09472 
0.4566 
64 


0.04401 

D.v096 
74 


0.66848 
0.0001 
74 


INTEREST IN LEARNING SPANISH 


0.06357 
0.6149 
65 


"0.00282 
0.9824 
64 


-0.00045 
0.9970 
74 


1 .00000 
0. 0000 
74 


ACHCOMP 

PRETEST COMPOSITE SCORE TST1-TST12 


0. 17681 
0. 1492 
6B 


0.1127 1 
0.3601 
68 


0. 06926 
0.5660 
71 


0.38274 
0.00 10 
71 


PACHCOMP 

POST COMPOSITE SCORE PTST 1 -PT ST 1 2 


0.3970B 
0.0006 
7 1 


0.35993 
0.C020 
7 1 


-0. 16869 
0, 150B 
74 


0.51 741 
0.0001 
74 


GA IN 

POSTTEST COMP - PRETEST COMP 


0. 29295 
0.0153 
6B 


0.31215 
0.0096 
68 


-0.29247 
0.0133 
7 1 


0.12705 
0.29 1 1 
71 


COMP 

PIMSLEUR COMPOSITE ON PRE TEST 


0.46047 
0.0001 
70 


0.58150 
0.0001 
70 


-0. 15740 
0.1035 
73 


-0.05182 
0.6633 
73 


LNGANAL 

PIMSLEUR LANGUAGE ANALYSIS SCALE - PRE 


0.36550 
0.D019 
70 


0.40968 
0 . 000 1 
70 


-0 . 1 1637 
0.3268 
73 


0. 139 28 
0. 2399 
73 


SSASSOC 

PIMS. SOUND-SYMBOL ASSOC. SCALE - PRE 
* 


0.3702B 
0.0012 
70 


0.36077 
0.0017 
70 


-0.25827 
0.0274 
73 


-0.18517 
0.1 168 
73 


SNDISCR 

PIMSLEUR SOUND DI SCRIM SCALE - PRE 


0.29720 
0,0124 
70 


0. 22809 
0.0576 
70 


-0.05178 
0.6635 
73 


0. 10793 
0.3634 
73 


VOCAO 

PIMSLEUR VOC\BULARY SCALE - PRE 


0.24183 
0.0437 
70 


0.40628 
0 . 000 1 
70 


-0.04342 
0.7153 
73 


-0.10812 
0.1 1 10 
73 



72 



CORRELATION COEFFICIENTS / PROB > |R| UNDER H0:RHO=0 
/ NUMBER OF OBSERVATIONS 



D2TST1 



D2TST2 



02TST3 



1.00000 
0.0000 
72 

0.59755 
0.0001 
70 

0.36718 
0.0026 
65 



0.59755 
0.0001 
70 

1 .00000 
0.0000 
70 

0.27375 
0.0273 
65 



0.36718 
0.0026 
65 

0.27375 
0.0273 
65 

1 .00000 
0.0000 
65 



D3TST1 


D3TST2 


D^TSTI 


D^TST2 


0.15283 


0.62301 


0.66267 


0.51632 


0.2100 


0.0001 


0.0001 


0.0001 


69 


69 


66 


66 


0.02252 


0.70669 


0.6^137 


0.56985 


0.8565 


0.0001 


0.0001 


0.0001 


67 


67 


64 


64 


0.3d902 


0.3239C» 


O.C»285t 


0.31249 


0.0016 


0.0096 


0.0006 


0.0151 


63 


63 


60 


60 



0.29385 
0.0166 
66 

0.34460 
0.0053 
64 

0.13089 
0.3183 
60 



D3TST1 



0. 15283 
0.2100 
69 



0.02252 
0.8565' 
67 



0.38902 
0.0016 
63 



1.00000 
0.0000 
73 



0.07180 
0.5461 
'73 



-0.08843 
0.4802 
66 



•0.17013 
0.1754 
65 



■0.11969 
0.3423 
65 



D3TST2 



0.62301 
0.0001 
69 



0.70669 
0.0001 
67 



0.32394 
0.0096 
63 



0.07180 
0.5461 

' 73 



1.00000 
0.0000 
73 



0.66702 
0.0QO1 

-66 



0.63091 
O.OOOt 
65 



0.29207 
0.0182 

. --65 



04TST1 



0.66267 
0.0001 

66 



0.64137 
0.0001 
64 



0.42851 
0.0006 
60 



-0.08843 
0.4802 
66 



0.66702 
0.0001 
66 



1.00000 
0.0000 
69 



0.71463 
0.0001 
68 



0.53081 
0.0001 
• 68 



04TST2 



0.51632 
0.0001 
66 



0.56985 
0.0001 
64 



0.31249 
0.0151 
60 



-0.17013 
0.1754 
65 



0.63091 
0.0001 
65 



0.71463 
0.0001 
68 



1 .00000 
0.0000 
68 



0.346t1 
0.0038 
68 



D«fTST3 



0.29385 
0.0166 
66 



0.34460 
6.0053 
64 



0.13089 
0.3188 
60 



-0.11969 
0.3423 
65 



0.29207 
0.0182 
65 



0.53081 
0.0001 
68 



0.34611 
0.0038 
68 



1.00000 
0.0000 
68 



05TST1 



0.50438 
0.0001 
71 



0.32279 
0.0064 
70 



0.35138 
0.0041 
65 



0.11995 
0.3191 
71 



0.47031 
0.0001 
71 



0.36044 
0.0027 
67 



0.45672 
0.0001 
67 



0.26999 
0.0271 
• 67 



05TST2 



D5TST3 



0.34706 
0.0030 
71 

0.50210 
0.0001 
71 



0.35095 
0.0029 
70 

0.56101 
0.0001 
70 



0.09686 
0.4427 
65 

0.27173 
0.0286 
65 



0.03242 
0.7884 
71 

0.04566 
0.7054 
71 



0.40635 
0.0004 
71 

0.58698 
0.0001 
71 



0.46397 

e.0001 

67 

0.58582 
0.0001 
67 



0.39239 
0.0010 
67 

0. 50970 
0.0001 
67 



0.07173 
0.5640 
67 

0.20823 
0.0908 
67 



D6TST1 



0.53234 
0.0001 
62 



0.54323 
0.0001 
61 



0.34376 
0.0082 
58 



-0.05803 
0.6514 
63 



0.59415 
0.0001 
63 



0.61802 
0.0001 
59 



0.49047 
0.0001 
5A 



0.23436 
0.0766 
58 



D6TST2 



0.45062 
0.0002 
62 



0.42171 
0.0007 
61 



0.27086 
0.0397 
58 



-0.15108 
0.2372 
63 



0.50771 
0.0001 
63 



0.43021 
0.0007 
59 



0.4U74 
0.0012 
58 



0.08759 
0.5132 
56 



63 



73 



CORREUTIOM COEFFICIEKTS / PROB > |r| UKOER HO:RHO=0 
/ NUMBER OF OBSERVATIOKS 



D2TSTt D2TST2 D2TST3 D3TST1 D3TST2 D^TSTt 



D6TST3 



D7TST1 



C7TSV2 



D8TST1 



DSTST2 



D9TSTI 



D9TST2 



D10TST1 



DtOTST2 



0.^52^0 
0.0002 
62 

0.5936A 
0.0001 
69 

0.49404 
0.0001 
69 

0.58269 
0.0001 
68 

0.27597 
0.0261 
65 

0.33092 
0.0055 
69 

O.2fi074 
0.0195 
69 

0.32136 
0.0096 
64 

0.64267 
0.0001 
63 



0.52868 
0.0001 
61 

0.50882 
0.0001 
67 

0.55813 
0.0001 
67 

0.54184 
0.0001 
66 

0.28207 
0.0239 
64 

0.48004 
0.0001 
67 

0.35600 
0.0031 
67 

0.28390 
0.02^1 
63 

0.66878 
0.0001 
63 



0.18682 
0.1603 
58 

0.25508 
0.0454 
62 

0.22087 
0.0845 
62 

0.26897 
0.0361 
61 

0.28320 
0.0297 
59 

0.30237 
0.0169 
62 

0.31057 
0.0140 
62 

0.124^8 
0.3433 
60 

0.17915 
0,1708 
60 



-0.16030 
0.2095 
63 

0.00965 
0.9368 
70 

-0.00107 
0.9930 
70 

-0.16946 
0.1639 
69 

0.00468 
0.9703 
66 

-0.13411 
0.268<^ 
70 

-0.01836 
0.8801 
70 

-0.06681 
0.5969 
65 

0.08543 
0.5021 
6^ 



a. ^6428 
0 .0001 
63 

0.59625 
0,0001 
70 

0.53156 
0,0001 
70 

0.57193 
0.0001 
69 

0.32190 
0.008^ 
66 

0.52656 
0.0001 
70 

0.30998 
0.0090 
70 

0.36549 
0«0028 
65 

0.66265 
0.0001 
6^ 



0.48263 
0.0001 
59 

0.63727 
0.0001 
66 

0.56692 
0 .0001 
66 

0.6587^ 
0.0001 
65 

0.30436 
0.0162 
62 

0.59440 
0.0001 
65 

0.52623 
0.0001 
65 

0.36321 
O.O043 
60 

0.65911 
0.0001 
59 



D4TST2 


D4TST3 


0.43512 


0.23488 


0.0006 


0.0759 


58 


58 


0.59024 


0.25549 


0.0001 


0.0400 


65 


65 


0.47668 


0.40875 


0.0001 


0.0007 


65 


65 


0.59964 


0.36193 


0.0001 


0.00 33 


64 


64 


0.31253 


0.34214 


0.0142 • 


' 0.0070 


61 


61 



0.58832 
0.0001 • 
65 

0.36876 
0.0025 
65 

0.36416 
0.0042 
60 

0.60813 
0.0001 
5> 



0.23860 
- 0.0556 
65 

0.30304 
0.0141 
65 

0.22304 
-0.0867 
60 

0.34006 
-■0.0084 
59 



D5TST1 D5TST2 D5TST3 D6TST1 p6TST2 D6TST3 D7TST1 D7TST2 



D2TS1 1 


0.50438 


0.34706 


0.50210 


0.53234 


0.45062 


0.45240 


0.59364 


0.49404 




0.0001 


0.0030 


0.0001 


0.0001 


0.0002 


0.0002 


0.0001 


0.0001 




71 


71 


71 


62 


62 


62 


"69 


— 69 


D2TST2 


0.32279 


0.350 95 


0.56101 


0.54323 


0.42171 


0.52868 


0.50882 


0.55613 




0.0064 


0.0029 


0.0001 


0.0001 


0.0007 


0.0001 


0.0001 


0.0001 




70 


70 


70 


61 


61 


61 


67 


. 67 


02TST3 


0.35138 


0.09686 


0.27173 


0 . 34376 


0.27086 


0.18682 


0.25506' 


•0.22067 




0.0041 


0.4427 


0.0286 


0.0082 


0.0397 


0.1603 


0.0454 


0.0845 




65 


65 


65 


56 


56 


58 


62 


^ ' ^2 



64 



74 



'CORRELATION COEFFICIENTS / 
/ NUMBER OF OBSERVATIONS 





DSTSTt 


D5TST2 


D5TST3 


D6TST1 


D3TST1 


0.tt995 
0.3191 
7t 


0.03242 
0.7854 
7t 


0.04566 
0.7054 
71 


-0.05803 
0.6514 
63 


D3TST2 


0.47031 
0.0001 
71 


0.40635 
0.0004 
7t 


0.56696 
0.0001 
71 


0.59415 
0.0001 
63 


D4TST1 


0.36044 
0.0027 
67 


0.46397 
0.0001 
67 


0.56582 
0.0001 
67 


0.61802 
0.0001 
59 


D4TST2 


0«45672 
0.0001 
67 


0 .39239 
0.0010 
67 


n CA07A 

0.0001 
67 


U . 4V0H / 

0.0001 

58 


D4TST3 


0.26999 
0.0271 
67 


0.07173 
0.5640 
67 


0.20823 
0.0906 
67 


0.23436 
0.0766 
58 


D5TST1 


1 .00000 
0.0000 
74 


0.16076 
0.1712 
74 


0.40049 
0.0004 
74 


0*. 26555 
0.0339 
64 


D5TST2 


0.16076 
0.1712 
74 


1.00000 
0.0000 
74 


0.45550 
0.0001 
74 


0.36642 

o.ooa9 

64 


D5TST3 


0.40049 
0.0004 
74 


0.45550 
0.0001 
74 


1.00000 
0.0000 
74 


0.68779 
0.0001 
64 



D6TST1 



D6TST2 



^06TST3 



D7TST1 



^07TST2 



PROB > iRl Ut^bER H0:RHO=0 " — 

06TST2 D6TST3 D7TST1 D7TST2 



0.26555 0.36642 
0.0339 0.0029 



64 



64 



0.35999 0.46965 
0.0035 0.0001 



64 



64 



0.31045 0.36935 
0.0125 0.0015 



64 



64 



0.30445 0.44130 
0.0104 0.0001 



70 



70 



0.2rt59 0.40462 
0.0356 0.0005 



70 



70 



0.66779 
0.0001 
64 

0.50162 
0.0001 
64 

0.62875 
0.0001 
64 

0.66263 
0.0001 
70 

0.57515 
0.0001 
70 



1 .00000 
0.0000 
66 

0.45603 
0.0001 
65 

0.55482 
0.0001 
65 

0.61656 
0.0001 

64 

0.54613 
0.0001 
64 



-0.15108 
0.2372 
63 

0.50771 
0.0001 
63 

0.43021 
0.0007 
59 

0.41474 
0.0012 
58 

0.08759 
0.5132 
58 

0.35999 
0.0035 
64 

0.48965 
0.0001 
64 

0.50162 
0.0001 
64 

0.45603 
O.0OC1 
65 

1 .00000 
0.0000 
65 

0.61281 
0.0001 
65 

0.52667 
0.0001 
63 

0.48406 
0.0001 
63 



•-0.16030 
0.2095 
63 

0.46428 
0.0001 
63 

0.48263 
0.0001 
59 

0.43512 
0.0006 
58 

0.23488 
0.0759 
53 

0.31045 
0.0125 
64 

0.38935 
0.0015 
64 

0.62675 
0.0001 
64 

0.58482 
0.0001 
65 

0.61281 
0.0001 
65 

1 .00000 
0.0000 

65 

0.69019 
0.0001 
63 

0.54067 
0.0001 
63 



0.00965 
0.9366 
70 

0.59825 
0.0001 
70 



-0.00107 
-0.9930 
70 

0.53156 
■0.0001 
70 



0.63727 0.56692 
0.0001 0.0001 
66 66 



0.59024 
0.0001 
65 



0.47668 
0.0001 
65 



0.25549 0.40875 

0.0400 0.0007 

65 65 

0.30445 0.25159 

0.0104 0.0356 

70 70 

0.44130 0.40462 

0.0001 0.0005 

70 70 



0.66263 
0.0001 
70 



0.575,15 
0.0001 
70 



0.61656 0.54613 

0.0001 O.0OO1 

64 64 

0.52687 0.48406 

0.0001 0.0001 

63 63 

0.69019 0.54067 

0.0001 0.0001 

63 63 

1.00000 0.73526 

0.0000 -0.0001 

74 74 



0.73526 
0.0001 
74 



1 .00000 
0.0000 
74 



65 



75 




COBREUTION COEFFICIENTS / 
/ NUM3ER OF OBSERVATIOMS 



D9TST1 



PROS > IRI UNDER HO«RHO=0 
D5TSH D5TST2 05TST3 D6TSH D6TST2 D6TST7 



D5TST1 0.3^395 0.37^62 
0.0038 0.0015 
69 69 

08TST2 0.38823 -0.02798 
0.0012 0.8222 
67 67 



0.27537 0.3036^ 
0.0201 0.0010 



71 



71 



D9TST2 0.09632 0.36932 

0.^2^2 0.0015 

71 71 

010TST1 0.18667 0.3^722 

0.133^ 0.00^3 

66 66 

O10TST2 0.^1188 0.^3607 

0.0006 0.0002 

66 66 



0.52852 
0.0001 

69 

0.32891 
0.0066 
67 

0.^8678 
0.0001 
7t 

0.41551 
0.0003 
71 

0.32393 
0.0060 
66 

0.61357 
0.0001 
66 



0.53695 
0.0001 
63 

0.35010 
0.0057 
61 

0.43583 
0.0004 
62 

0.30205 
0.0170 
62 

0.28048 
0.0314 
59 

0.63072 
O.OOOt 
59 



0.45806 
0.0002 
62 

0.42067 
0.0008 
60 

0.44706 
0.0003 
61 

0.20133 
O.t i97 
61 

0.10038 
0.4512 
58 

0.44072 
0.0005 
58 



0.67692 
0.0001 
62 

0.37261 
0.0034 
60 

0.34938 
0.0058 
61 

0.36283 
0.0041 
61 

0.22931 
0.0834 
58 

0.55746 
0.0001 
58 



D7TST1 


D7TST2 


0.76564 


0.55207 


O.OOOt 


0.0001 


71 


71 


0.28332 


0.21362 


0.0192 


0.0803 


68 


68 


0.45309 


0.44571 


0.0001 


0.0001 


71 


71 


0.44838 


0.35553 


0.0001 


• O.O023 


71 


71 


0.34223 


0.34042 


0.0046 


0.0048 


67 


67 


0.69497 


0.59333 


0.0001 


0.0001 


66 


66 



08TST1 D8TST2 D9TST1 09TST2 DIOTSTI D10TST2 



D2TST1 



D2TST2 



D2TST3 



D3TST1 



D3TST2 



04TST1 



0.58289 
0.0001 
68 

0.54184 
0.0001 
66 

0.26897 
0.0361 
61 

-0.16946 
0.1639 
69 

0.57193 
0.0001 
69 

0.65874 
0,0001 
65 



0.27597 
0.0261 
65 

0.28207 
0.0239 
64 

0.28320 
0.0297 

5V 

0.00^68 
• 0.9703 
66 

0.32190 
0.0084 
66 

0.30436 
0.0162 
62 



0.33092 


0.28074 


0.32136 


0.64267 


0.0055 


0.0195 


0.0096 


0.0001 


69 


69 


64 


63 


0. 49004 


0.35600 


0.2d390 


0.66878 


0.0001 


0.0031 


0.0241 


0.0001 


67 


67 


63 


63 


0.30237 


0.31057 


0.12448 


0.17915 


0.0169 


0.0140 


0.3433 


0.1708 


62 


62 


60 


60 


0.1341 1 


-0.01836 


-0.06681 


0.08543 


0.2684 


0.8801 


0.5969 


0.5021 


70 


70 


65 


64 


0.52656 


0.30998 


0.36549 


0.66285 


0.0001 


0.0090 


0.0028 


0.0001 


70 


70 


65 


64 


0.59440 


0.52623 


0.36321 


0.65911 


0.0001 


0.0001 


0.0043 


0.0001 


65 


65 


60 


59 



66 



76 



CORRELATION COEFFICIENTS / PROD > 1r| Urn)ER H0:RHO50 
/ NUMBER OF OBSERVATIONS 



D9TST2 DtOTSTt 

0.36876 0.36^16 

0.0025 0.00^2 

65 60 

0.3030^ 0.22304 

0.0141 0.0867 

65 60 

0.09632 0.18667 

0.4242 0.1334 

71 66 



D8TST1 D8TST2 09TSTt 

0^TST2 0.59964 0.31253 0.58832 

0.0001 0.0142 0.0001 

64 61 65 

D4TST3 0.36193 0.34214 0.23860 

0.003'i 0.0070 0.0556 

64 61 65 

D5TST1 0,34395 C-3e823 0.27537 

0.0036 0.0012 0.020; 

69 67 71 

D5TST2 0.37462 -0.02798 0.38364 

0.0015 0.8222 0.0010 

69 67 71 



05TST3 0.52852 
0.0001 
69 

D6TST1 0.53695 
0.0001 
63 

D6TST2 0.45806 
0.0002 
62 

D6TST3 0.67692 
0.0001 
62 

D7TST1 0.76564 
0.0001 
71 

07TST2 0.55207 
0.0001 
71 

08TST1 1.00000 
0.0000 
73 

0STST2 0.32374 
» 0.0063 
70 

D9TST1 0.43575 
0.0002 
70 

09TST2 0.37658 
0.0013 
70 

D10TST1 0.26289 
0.0344 
65 

D10TST2 0.66362 
0.0001 
64 



0.32891 


0.48678 


0.0066 


0.0001 


67 


y\ 


0.35010 


0.43583 


0.0057 


0.0004 


61 


62 


0.42067 


0.44706 


0.0008 


0.0003 


60 


61 


0.37261 


0.34936 


0.0034 


O.OOSd 


60 


61 


0.28332 


0.45309 


0.0192 


0.0001 


68 


71 


0.21362 


0.44571 


0.0803 


0.0001 


68 


71 


0.32374 


0.43575 


0.0063 


0.0002 


70 


70 


1.00000 


0.27741 


0.0000 


0.0230 


70 


, 67 


0.27741 


1.00000 


0.0230 


0.0000 


67 


74 


0.07903 


0.39022 


0.5250 


0.0006 


67 


74 


'0.05779 


0.23640 


0 . 6555 


0.0541 


62 


67 


0.24045 


0.38502 


0.0598 


0.0014 


62 


66 



0.36932 


0.34722 


0.0015 


0.0043 


/ 1 


AA 
DD 


0.41551 


0.32393 


0.0003 


0.0080 


7^ 


66 


0.30205 


0.28048 


0.0170 


0.0314 


62 




0.20133 


0.10088 


0.1197 


0.4512 


O 1 


C A 
SO 


0.36283 


0.22931 


0.0041 


0.0S34 


61 


58 


0.44838 


0.34223 


0.0001 


0.0046 


71 


67 


0.35553 


0.34042 


0.0023 


0.0048 


71 


67 


0. 37658 


0 . 26289 


0.0013 


0.0344 


70 


65 


0.07903 


-0.05779 


0.5250 


0.6555 


67 


62 


0.39022 


0.23640 


0.0006 


0.0541 


74 


67 


1.00000 


0.31893 


0.0000 


0.0085 


74 


67 


0.31893 


1 .00000 


0.0085 


0.0000 


67 


69 


0.39480 


0.41367 


0.0010 


0.0005 


66 


68 



DtOTST2 

0.60813 
0.0001 
59 

0.34006 
0.0084 
59 

0. 41168 
0.0006 
66 

0.43807 
0.0002 
66 

0.61357 
0.0001 
66 

0.63072 
0.0001 
59 

0.44072 
0.0005 
58 

0.55746 
0.0001 
58 

0.69497 
0.0001 
66 

0.59333 
0.0001 
66 

0.66362 
0.0001 
64 

0.24045 
0.0598 
62 

0.38502 
0.0014 
66 

0.39480 
0.0010 
66 

0.41367 
0.0005 
68 

1.00000 
0.0000 
68 



67 



TABLE 7 
Daily Test C!uster<: 



SAS 

OBLIQUE PRINCIPAL COMPONENT CLUSTER ANALYSIS 

4] OBSERVATIONS PROPORTION O.OOOOOO 

22 VARIABLES HAXElGEN ** 1.0000 

ORtHOBLIQUE INITIALIZATION 

CLUSTER SUHrtARY FOR h CLUSTERS 

CLUSTER VARIATION PROPORTION- 
CLUSTER HEHBERS VARIATION EXPLAINED EXPLAINED 

1 10 10,000000 6,250279 0,6250 

2 3 3,000000 1,805233 0,6017 

3 1 1,000000 1,000000 UOOOO 
h 8 8,000000 A, 926758 0,6158 

TOTAL VARIATION EXPLAINED - r3, 98227 PROPORTION ■ 

R-SQUARED WITH 
OWN NEXT R**2 

VARI ABLE CLUSTER HI GHEST RATI 0 

CLUSTER I 

. D2TST2 0,6762 0,5550 0;8207 
D5TST.3 0 . 6900 0 , (»752 0 , 6887 
D6TSTI 0.6626 0,(»533 0,68y 
D6TST2 0.5527 0,30ltO 0.5500 
D6TST3 0.7089 0,3173 0,t»t»77 
D7TST1 O.76I8 . 0,Ii736 0,6217 
D7T.ST2 0,581(8 . 0,ltltlt6 0,7603 ' 
D8TST] 0.7050 0,53'tl 0,7575 
D8TST2 0,^872 0,76'»6 

D10TST2 0.663'* 0M}5 0,6656 

CLUSTER 2-^ I 

D5TST2 0.6^181 0,2072 0,3196 
D9TST2 0.5895 0,1831 0,3107 

DlOTSTl 0.5676 0,tS60 0,1692 

CLUSTER 3 

D3TST1 » 1. 0000 0,011^*^ 0,01^3 
CLUSTER k f_ 

D2TST1 0.71 63 0,6521 0.8325 

D2TST3 0.5355 0,2657 0,t»962 

D3TST2 0.7'i51 0,5819 0,7810 

D'fTST.l , 0.8527 0,6261 0.73(»3 

D'fTST2 0.6973 0,W6 0,709'* 

Dt»TST3 0.3226 0.1279 0.396ti 

D5TSTr 0.593'» 0,3382 0,5700 

D9TSTI OMUO 0,2t»93 0,5373 



SECOND 
EIGENVALUE 
1,0005'»8 
0,6'»7090 

0,871826 

0.635558 



The ach 
are: for 
1 and 2) 
from a 1 
multiple 
tions of 
student 
make sen 
mance on 
task: a 
meaning 
structur 
indicat i 
adv Isabi 
test Ing 



levement tests tests which clustered together, above. 
Day 2 (tests 1 and 3)> Day 3 (test 2), and Day 4 (tests 
Three of these tests Involve matching vocabulary items 
ist with blanks in sentences from the lesson, one is a 
-choice comprehension exercise based on English transla- 
sentences from the lesson, and the fifth requires the 
to Identify which one of three similar Spanish sentences 
se. It appears clear that statistically similar perfor- 
these five tests was due to the similar nature of the 
11 of the tests require global understanding of the 
of the sentences, rather than focusing on any particular 
e they might contain. Since clustering tends to be an 
on of test -eliabil ity, these findings suggest the 
lity of using these types of tests when integrative 
is desired. 
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APPENDIX E- 

The Pirasleur Language Aptitude Battery <PLAB), developed for 
use in Grades 7-12, containes five subtests to assess different 
aspects of language aptitude. These subtests and a description of 
the specific ability <les) each is designed to test are as 
follows (Pimsleur, 1966). 



1. Interest in learning a foreign language: designed to 
give an indication of a student's notivation. 

2. Vocabulary: word knowledge in English; designed, along 
with the next section on language analysis , to 
provide information regarding a student's verbal 
ability and his ability to handle the Mechanics of a 
foreign language, 

3. Language analysis: ability to reason logically in 
terms of a foreign language. 

4. Sound discrimination: ability to learn new phonetic 
distinctions and to recognize them In different 
contexts; designed to test the student's ability to 
hear and retain new sounds. 

5. Sound-symbol association: an association of sounds 
with their written symbols; designed to measure a 
student's ability to associate Engl ish-lanuage sounds 
with their written symbols. 



* Extracted from Robinson, 1981 

In the present study only subtests 2-5 were used. 
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APPENDIX A: 

iS^I2_Student_Back3roun^_Que;stionnair^ 
EKg,lTliiIiiiB2Q§£§i_Ji£iQSi._lE£Sli*Q2i£a4.-.E£ElSlQi§ia£§ 



MISSING DATA CODE =99 
UNUSABLE DATA CODE =98 



CODE 



FREQUENCY 
<N) PERCENT % 



GENDER: 



Male = 1, 

Fenale . . .=2. 



50 60 % 

33 40 % 



STUDENT 

ETHNICITY: Black 



=1 18, 

Caucasian/White =2 36. 

Asian =3 n. 

Other =4 7. 

99 2, 



24 
49 

i5 

.9 
.3 



OCCUPATION CODE: 

Professional . . . = 1 
Blue Collar. . . =2 
Business/Sales =3 

Service =4 

Other =5 

FATHER'S OCCUPATION = 1 

= 2 

= 3 

= 4 

=5 

99 

MOTHER'S OCCUPATION = 1 

= 2 

= 3 

= 4 

=5 

98 
99 



40 54 % 

10 14 H 

.9 12 % 

.6 8 % 

.5 7 % 

.4 5 % 

23 31 % 

.2 3 h 

.6 8 H 

18 24 % 

16 22 % 

. 1 1 % 

.8 11 H 
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(PLEASE PILL-IN OR CIRCLE YOUR ANSWERS, AS INDICATED.) 
PLACE OP BIRTH} 



CITY/TOWN STATE COUNTRY 



Q.#2: WHAT OTHER FOREIGN LANGUAGES (BESIDES SPANISH) HAVE YOU 
FORMALLY STUDIED ? 

FREQUENCY 
CODE (N) PERCENT % 

Gr^ek =1 3 4 h 

Portugese =2 1 I % 

French. .. =3 7 10 % 



Chinese . 
Japanese 
Hebrew. . 
Other. . . 



=5 7 10 % 

=6 1 1 % 

=7 1 1 % 

=8 3 4 % 

99. , 51 69 % 



ERIC 



Q.#3: WHAT SPANISH COURSES HAVE YOU TAKEN BEFORE THIS ONE ? 

Level A 63 85 % 

Level B 63 85 % 

Level 1 21 28 -t 

Q.#4: WHAT LANGUAGES OTHER THAN (OR BESIDES) ENGLISH DO YOU OR 1 
YOUR FAMILY SPEAK AT HOME ? 

YOU SPEAK: 

Greek. ... = 1 3 4 % 

French... =3 1 1 % 

Spanish. .=4 9 1?, % 

Chinese. .=5 5 7 % 

Japanese. =^6 1 1 % 

Other. ...=8 2 3 % 

99 53 72 % 

FAMILY SPEAKS: 

Greek = 1 3 4 \ 

French... »3 1 1 % 

Sps:r.lsh. .=4 9 12 % 

Chinese. .=5 7 10 % 

Japanese. =6 2 3 % 

Hebrew... =7 1 1 % 

Other =8 4 5 % 

99 47 64 H 

70 



82 



Q.#5: HAVE YOU HAD ANY MUSICAL TRAINING ? 



CODE 



FREQUENCY 
<M) PERCENT H 



YES =1 60, 

NO =2 14, 



,81 H 
19 % 



Q.#6: IF YES, HOW LONG ? MEAN=3.5 Yrs . , N=59 



Q.#7: HOW MANY TIMES HAVE YOU HAD EXPERIENCE (USED OR PLAYED) 
WITH A COMPUTER ? Circle: 



2-10 x's. . 
10-20 x's. 
20-30 x's. 
1 month. . . 
2-6 months 
7-12 months 
1-2 years.. 



. = 1 , 

.=2 

.=3, 

.=4, 

.=5, 

.=6 

.=7. 



10, 
10, 
.9, 
.9, 
.6, 
. ^, 
12, 



2 yrs.+ more. =8 14, 

99 . , 9 



12 
12 
11 
11 
.7 
.5 
14 
17 
11 



Q.#8: THE TIMES YOU HAVE USED THE COMPUTER, WHAT WERE THE MAIN 
REASONS (INCLUDING GAMES) FOR USING THE COMPUTER ? 

Games (playing) = 1 42 57 % 

Programming =2 6 8 % 

Word Processing = 3 6 8 % 

Learning/Educational .=4 13 18 % 

Other =5 7 9 % 



Q.#9: HOW INTERESTED ARE YOU IN USING COMPUTERS ? 

MEAN=3.2 
N =73 



Very Little 



Very Much 



= 1 ?. 3 h 

= 2 7 10 % 

= 3 35 47 % 

= 4 29 39 % 

98 1 1 % 

71 
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Q.#10; WHAT INTERESTS YOU THE MOST ABOUT COMPUTERS ? 



FREQUENCY 
CODE <N) PERCENT 

Games = 1 10 12 h 

Programming =2 10 12 % 

Graphics =3 5 6 H 

Ease of use =4 24 29 ^ 

Word Process ing. ... =5 4 5 H 

Nothln3 =5 2 2 % 

Other =7 14 17 V 

Job Skill =8 1 1 % 

Indiv. Instruction. =9 4 5 H 

99 9 11 H 



Q.#ll: WHAT INTERESTS YOU THE LEAST ABOUT COMPUTERS ? 



Boring =1 2 3 H 

Programming =2 9 12 H 

Confusing =3 4 5 % 

Nothing =4 12 16 % 

Impersonal Machine... =5 4 5 % 

Operation/ Mechanics. =6 20 27 % 

Other =7 5 7 % 

99 18 24 h 



Q.#12: DO YOU KNOW HOW TO TYPE ? 



Yes 55 66 % 

No 19 23 % 

99 9 11 % 



Q.#13: IF YES, HOW LONG ? MEAN=7 Months, N=59 



Q.#14: KOW INTERESTED ARE YOU IN LEARNING SPANISH "t 

MEAN=2.8 
N =74 

Not at All = 1 7, 8 

=2 18 22 '-i 

=3 33 40 H 

Very Interested. =4 16 19 H 

S9 9 11 % 

72 
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Q.#15: HOW MUCH DO YOU ENJOY SPANISH IN COMPARISON TO OTHER 
SUBJECTS ? 

FREQUENCY 

MEAN=2.3 CODE <N> PERCENT % 

N =74 

Least Favorite = 1 13 16 % 

Subject = 2 32 39 % 

=3 24 29 % 

Most Popular =4 5 6 % 

Subj ect 

99 9 11 % 



Q.#16: WHAT IS YOUR MOST IMPORTANT REASON FOR STUDYING SPANISH ? 



Language learning. . . = 1 18 22 

Travel =2 6 7 

Credits : Col lege /HS. .=3 20 24 

Jobs; Work =4 7 8 

Learn about people.. =5 2 2 

No reason =6 1 1 

Communicate /people . .=7 10 12 

Other =8 10 12 

99 9 11 



■ % 



Q.#17: WHAT ARE 
PEOPLE ? 



YOUR GENERAL IMPRESSIONS OF SPANISH-SPEAKING 



MEAN=2.2 
N =61 



Negative . . . = 1 10, 



Neutral .... =2 . 



,29. 



Positive . . .=3 22. 



99. 
98. 



13 % 

38 % 

29 % 

13 17 % 

.3 4 % 



Q.#18: WHAT COUNTRY DO YOU THINK THE PEOPLE YOU ARE TALKING ABOUT 
COME FROM ? 

Mex ico =1 26 35 % 

Spain =2 36 49 % 

South America... =3 3 4 % 

Central America. =4 1 1 % 

Other =5 1 1 % 

99 6 8 fi 

98 1 I % 

73 
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Q.#19: HAVE YOU EVER MET OR SPOKEN TO SOMEONE WITH A SPANISH 
ACCENT ? 

FREQUENCY 
CODE <N) PERCENT '-i 

YES =1 63 85 H 

NO =2 9 12 H 

99 2 3 H 



Q.#20: IF YES, WHERE WAS HE OR SHE FROM ? 



Mexico = 1 29 39 % 

Spain =2 4 5 % 

South America... =3 S 8 H 

Central America. =4. 2 3 % 

United States... =5 10 

Other =6 1 1 H 

99 22 30 H 



14 



Q.#21: WHAT WERE YOUR PARTICULAR IMPRESSIONS OF THAT PERSON ? 

MEAN=2.6 
N =55 

Negative = 1 2 3 % 

Neutral =2 18 24 % 

Positive =3 35 47 H 

9? 1 1 % 

98 18 24 % 



74 
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In this section we want you to tell us If you agree or disagree 
with some statements about Spanish-speaking people. Circle the 
nunber that corresponds to your opinion. 

< ATTITUDES TOWARD SPANISH SPEAKERS) 
(a.#22! SPANISH SPEAKERS ARE FRIENDLY. 

FREQUENCY 

MEAN=3.2 CODE <N> PERCENT % 

N =53 

Totally Disagree 1 l..> 2 % 

2 10 17 H 

3 42 72 % 

Totally Agree 4 5 9 H 

Q,#23: I WOULD LIKE TO HAVE SPANISH SPEAKING FRIENDS. 

FREQUENCY 

MEAN=3.1 CODE <N> PERCENT % 

N =65 

Totally Disagree 1 0 0 % 

2 8 12 % 

3 43 66 % 

Totally Agree 4 14 22 % 

Q.#24: SPANISH SPEAKERS DON'T TALK RIGHT. 

FREQUENCY 

MEAN=1.5 CODE <N> PERCENT % 

N =70 

Totally Disagree 1 41 59 H 

2 21 30 % 

3 7 10 \ 

Totally Agree 4 1 1 % 

Q,#25: SPANISH SPEAKERS ARE INTELLIGENT. 

FREQUENCY 

MEAN=2.7 CODE <N> PERCENT H 

N =59 

Totally Disagree 1 3 o 5 % 

2 17 29 H 

3 36 61 H 

Totally Agree 4 3 5 % 
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ft. #26} SPANISH SPEAKERS ARE LAZY. 

FREQUENCY 

MEAN=1.6 CODE <N) PERCENT % 

N =62 

Totally Disagree 1 30 48 % 

2 29 47 H 

3 2 3 % 

Totally Agree 4 1 2 % 



ft. #27; I WOULD LIKE TO VISIT A SPANISH SPEAKING COUNTRY. 

FREQUENCY 

MEAN=3.5 CODE <N) PERCENT % 

N =71 

Totally Disagree 1 1 1 % 

2 7 10 % 

3 21 30 % 

Totally Agree 4 42 59 % 



Q.#28: SPANISH SPEAKERS ARE WELL LIKED IN SCHOOL. 

FREQUENCY 

MEAN=2.4 CODE <N) PERCENT % 

N =56 

Totally Disagree .1 4 7 % 

2 25 45 % 

3 25 45 % 

Totally Agree 4 2 4 % 



(MOTIVATION) 



Q.#29: LEARNING SPANISH WILL HELP ME GET A BETTER JOB. 

FREQUENCY 

MEAN=3.1 CODE <N) PERCENT % 

N =65 

Totally Disagree 1 4 6 % 

2 9 14 % 

3 27 42 % 

Totally Agree 4 25 38 % 
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Q.#30: I WANT TO LEARN SPANISH TO USE IN TRAVEL. 



FREQUENCY 



HBAN=3.3 
N =71 



CODE 



PERCENT H 



Totally Disagree 



Totally Agree 



2 
3 
4 



.3 
.8 

28 
32 



.4 % 
U % 
39 H 
45 H 



STATISTICALLY SIGNIFICANT GAIN SCORES OBTAINED FROM 
PRS-POS? QUESTIONNAIRE: INTEGRATIVE MOTIVATION 
(Items #31 and #32, combined) 



Q.#31: I WANT TO LEARN SPANISH IN ORDER TO HAKE NEW FRIENDS 
WITH SPANISH SPEAKERS IN THIS COUNTRY. 



Q.#32: I AM STUDYING SPANISH SO I CAN UNDERSTAND MORE ABOUT 
SPANISH-SPEAKING PEOPLE- AND THEIR CULTURE. 



COMBINED GAIN SCORE FOR ABOVE ITEMS: =1.14 <N)=73 P= .03 level 
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APPENDIX B; DESCRIPTION OF CAI MATERIALS 

Although students were given nine days of Instructional 
material/ there were actually 10 days of computer activities. 
The first day consisted of a computer orientation exercise 
developed especially for the project. The commercial "Apple 
Presents Apple** introductory program was considered/ but was 
found to contain several uses of the keys in ways which conflic- 
ted with the usage of the project programs. The day 1 orienta- 
tion provided a tutorial-type practice In using the RETURN key, 
back-space/ special Spanish characters^ plus an introduction to 
several of the special formats which students would encounter on 
subsequent days, such as cloze activltes and DASHER-type feed- 
back . 

Hypothesis: Known other vs. anonymous other 

New item: Reflexive with SE (third person singular) 

New vocab: afeltadora afeltarse barba 

cuarto de bano espejo levantarse 
llamarse mirarse vanldoso 

Teaching strategy: 

Experimental group: Students are first asked to type In the 
names of their favorite male TV or movie star and their favorite 
male singer. These names are then used by the program as key 
characters In the activities which follow. New material is 
introduced In a narrative concerning the daily life of these 
famous people, with visuals to aid in comprehension. This 
narrative Is followed by a multiple-choice comprehension exer- 
cise, in which the student guesses the English meaning of key 
sentences. Finally/ the students complete a cloze exercise in 
which they reconstruct part of the narrative. 

Control group: The control exercise is identical except 
that Instead of using names chosen by the students/ or even names 
of famous people whom they know, the narrative is about the 
anonymous Roberto and Mar fa. 

Example : Experimental Group 

**Estamos en la casa de otra persona muy popular. La persona 
se llama Prince. Prince trabaja por la noche . Por eso, se 
levrnta muy tarde . Va al cuarto de baKo. Es muy vanldoso 
tamblc^n. Por eso, se mira mucho en el espejo." 
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[Translation: We are In the house of another very popular 
person. The person's name is Prince. Prince works at night. So 
he gets up very late. He goes to the bathroorn. He Is also very 
vain. For this reason, he looks at himself in the mirror a lot.l 

1. ^Donde estamos? [Where are we?] 

2. JEs vanidoso? [Is he vain?] 

3. <?A donde va Prince? [Where does Prince go?l 

Sxair.ple: Control Group 

"Estamos en la casa de otra persona muy popular. La persona 
se llama Manuel Ortega. Manuel trabaja por la noche. Por eso, 
se levanta muy tarde. Va al cuarto de banc. Es muy vanidoso 
tamb ien . 

[Translation is exactly as above, with Manuel Ortega 
substituted every time the name "Prince" appears.] 

Dajr^3 

Hypothesis: Answer-judging hypothesis 2 (Student discovery) 

New vocab: ceplllarse comedor desayuno 

lavarse pe inarse prefer ir 

sentarse 

Teaching strategy: 

Both groups: Presentation and type of activities are 
similar to the experimental version of day 2, although new 
vocabulary and grammatical items are introduced. However, four 
different types of answer- j udg ing routines are used as feedback 
on the multiple-choice exercises: 

Group 1: Correct answer only 

After the first mistrial, the program responds with "Wrong, 
try again." After the second mistrial, the correct answer is 
given. 

Group 2: Correct answer with explanation 

After the first mistrial, the program responds with "Wrong, 
try again. After the second mistrial, the correct answer is 
given, along with an explanatory comment such as "The verb 
cepillarse means to brush." 

Group 3: Location of error only 

After the first mistrial, the program identifies the part of 
the student's chosen answer which is in error by displaying the 
corresponding sentence with blank spaces for the wrong part. This 
routine is repeated after the second mistrial; then, following a 
pause, the correct answer is given. 
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Group 4: Location of error with graded hints 

After both first and second mistrials, the program locates 
the error by blanking out the Incorrect part of the corresponding 
sentence, then gives a hint to help the student out (''She washes 
something but it Isn't the sink.**). The content of this hint 
varies according to which Incorrect sentence the student has 
chosen. 

Example : 

Students are shown the graphic of a girl brushing her teeth, and 
the sentence, "Luego, se cepllla los dientes.** 

[Then she brushes her teeth.] They are given three English 
sentences following, and are asked to select the correct trans- 
lation. For this sentence, the three choices were: 

a. After, she brushes her hair. 

b. After, she brushes her teeth. 

c. After, she washes her teeth. 

For all groups, if the correct answer was given on the first try, 
the computer responded, "Muy blen. She brushes her teeth.- 

Group 1: After first mistrial, ''Wrong, try again. - 

After second mistrial, "Answer: B. She brushes her 
teeth. *• 

Group 2: After first mistrial: "Wrong, try again." 

After second mistrial, "Answer: B. She brushes her 
teeth. The verb cepillarse means to brush." 

Group 3: After first mistrial, then error location. Dasher type: 

If student gave answer <a), then: 
She brushes - 

If student gave answer <c), then: 
She her teeth. 

After second mistrial, if (a or c) , then error location 
as above, with •*Do you want the correct answer or the 
next item?" 



If correct answer, then the response was; 
She brushes her teeth." 



"Answer: B. 



Group 4: After first mistrial, if (a) then error location: " She 
brushes - Hint: She brushes 

something but it isn't her hair." 
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After first mistrial, If <c) then error location:** She 
^ ^ ^ - ^ ^ ^ hgj^ teeth. Hint: She does something to 
her teeth, but it Isn't washes." 

After second mistrial, If <a>, then as above. 

After second mistrial, If <c), then as above. 



Hypothesis; 
New Item: 
Rev lew: 
New vocab: 



Integrated material vs. non- integrated material 
Use of reflexive pronoun <se) with plural verb forms 



Telling time 

banarse 
abr igo 



acostarse 
coleglo 



desayunar 



Teaching strategy: 



Experimental group: New forms and vocabulary are presented 
by means of an integrated context consisting of a reading passage 
about two junior high school girls in Spain, Rosl and Gabrlela. 
The passage Is given a title <**La vlda diaria de Rosl y Ga- 
briela**), follows a chronological sequence, and uses the same 
names throughout. Text Is accompanied by visuals on the graphics 
screen to assure comprehension. 

Follow-up practice Is also Integrated: multiple choice 
questions about the meaning of key sentences from the passage, 
and a cloze exercise In which students reconstruct key sentences 
from the passage. 

Control group: The same new forms and vocabulary are 
presented by means of a series of unconnected scenes, following 
no sequence and using several different and unrelated characters 
and names. Fol low-up pract ice cons is ts of mul t iple-cho Ice 
questions about the meaning of key sentences from the presenta- 
tion, and a cloze exercise in which students reconstruct these 
unrelated sentences. 

Example : Experimental group 

[The following Is an excerpt from Day 4's activities] 
Each concept was accompanied by an explanatory graphic. 

**La vida diaria de Rosl y Gabriela" 



"•Estas dos chicas vlven en 
1 laman Ros i y Gabr le la . 
Gabrlela tlene 15.. ..Las 
media. A las slete menos 



Burgos, una ciudad en Espana. Se 
Son hermanas. Rosi tlene 13 anos. 
hermanas se levant an a las se Is y 
cuarto, se banan. Despues, se ponen el 



uniforme . . . .Se ponen el abrlgo para sallr, porque hace frfo en 
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Burgos .Por la noche , Rosl y Gabrlela se ceplllan los dlentes.** 



[Translation: The Dally Life of Rosl and Gabrlela 

These two girls live In Burgos, a city in Spain. Their names are 
Rosl and Gabrlela. They are sisters. Rosl Is 13 years old. 
Gabrlela Is 15. ...The sisters get up at six thirty. At quarter 
to seven they take a bath. Afterv»ards, they put on their 
un If orms . . . . They put on their coats to go out, because It Is cold 
In Burgos.... At night, Rosl and Gabriela brush their teeth." 

The section following this ''story*' gives the students the same 
sentences, one or two at a tlme> and asks the students to choose 
the English sentence among 3 choices which gives the closest 
translation of the story line. 

Example; Control group 

In the non- Integrated version of this activity, the students were 
given the following sentences to learn the same material: Again, 
the sentences are accompanied by graphics Illustrating the 
activities described. 

"Rosl y Gabrlela se ponen la ropa para Ir a la escuela. 

Los hombres se levantan a las sels y media. 

Roberto y su hermano se banan por la noche . 

Los chlcos se ponen el abrlgo para sallr. 

Por la noche, las muchachas se cepillan los dlentes." 

[Translat Ion 3 

-Rosi and Gabriela get dressed to go to school. 
The men get up at six thirty* 
Roberto and his brother take a bath at night* 
The children put on their coats to go out. 
At night, the girls brush their teeth." 

Following these sentences, the students were asked to complete 
parallel exercizes as for the experimental group. 

Hypothesis : Emot Ion (humor) vs . non-emot Ion 

New Item: Reflexive ME (recognition/production), TE (recogni- 

tion) 
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New vocab: anuncio 
chlste 
sopa 
champu 

Teaching strategy: 

Expe r I mental gro up : 



1 Imp larse 
sofa 
pelo 
jabon 



champan pensar 
cuchlllo cepillo 
pi Jama jamon 



New forms and vocabulary are presented 
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In the context of a humorous dialog concerning two boys who are 
making up "commercials" about toothpaste and shampoo^ etc. 
Follow-up practice consists of having students answer similar 
silly questions about themselves. Answers are in the form of 
complete sentences In which the forms of the verb and the 
reflexive pronoun are checked for feedback by the program. 

Control group: Presentation Is also in the form of a dialog 
between two boys. This time, however, the dialog Is entirely 
lacking in < Intentional ) humorous content , since the boys are 
merely asking each other what they use to brush their teeth, etc. 
Practice is the same as for the experimental group, except that 
the questions are matter-of-fact. 

Example: Experimental group 

For the experimental group, the day's act i vlt les 
started with the following questions, accompanied by 
graphics, illustrating the subject, (the questions were 
briefly answered in a conversational way) 

?Te lavas el pelo con champu o con champan? 

[Do you wash your hair with shampoo or champagne?) 

?Y te lavas con jamon o con jabon? 

[And do you wash with jam or with soap?l 

?Y te sientas en el sofa o en la sopa? 
[Do you sit dov/n on the sofa or on soap?] 

Example: Control group 

The control group, (non-humorous) had two boys talk lag 
together, with one boy interviewing the other, asking questions 
such as the following: 

?Te lavas el pelo con champu? 

[Do you wash your hair with shampoo?] 

?Te banas con agua cal ietite? 
[Do you bathe with hot water?] 

?Te sientas en el sofa para ver la television? 
[Do you sit on the sofa to watch television?] 

Q§}!,.§-.l^ctivit}[_Sa) 

Hypothesis: Answer-judging hypothesis 5 (recycling of missed 
items) 

New item; Choosing the right reflexive pronoun (me/te/se) 

Review Item: Weather terms with HACER 
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NEW VOCAB: qultarse sueter zapatos 

gafas de sol impermeable 

Teaching strategy: 

Both groups: New material is presented by means of visuals 
with text commenting on the particular types of clothing which 
are worn in different kinds of weather. Practice for all groups 
consists of a fill-In exercise requiring the students to type in 
the correct form of the verbs PONER or QUITAR and the appropriate 
reflexive pronoun <ME, TE, or SE). Treatments differ only in the 
form of answer- j udg ing/error feedback. 

Answer-judging groups differ in the manner in which missed 
material is recycled. Treatment after the first mistrial is 
identical for all four groups: the program responds with " Como?" 
and the student tries again. After the second mistrial, the 
correct answer is given* If missed again, the missed form is 
then recycled in four different ways: 

AJ group 1: Immediate repetition of same item. 

The same item is repeated immediately following the second 
mistrial. 

AJ group 2: Immediate repetition of parallel item. 

A parallel item <same form, different context) is given follow- 
ing the second mistrial. 

AJ group 3: Repetition of missed items together at the end. 

Missed items are stored, then repeated at the end of the exer- 
cise • 

AJ group 4: Repetition of missed items at random intervals. 

Missed items are stored and repeated at random intervals during 
the exerc ise . 

Actj,vitjr_6b 

Hypothesis: Problem-solving activity vs. non-problem-solving 
New i tems : Locat i ve pre pos it ions 

New vocab: delante de/detras de dentro de entre 
debajo de/encima de 

bic icleta 

Teaching strategy: 

Both groups: The computer "draws*" a picture of a house, 
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Identifying each new object as it is drawn by means^of a sentence 
with a locative preposition <"La biclcleta esta delante del 
arbol"). [The bicycle is under the tree,] This Is followed by a 
set of true-false comprehension questions on the location of the 
objects. 

Experimental group: The picture is now scrambled and the 
student is given the problem of unscrambling by answering 
multiple choice questions about where the objects should appear. 
Providing the correct answers causes the object to return to its 
proper place . 

Control group: The picture Is as before. The student must 
merely answer nul t iple-cho ice questions concerning the location 
of the objects. There is no problem to solve, only straightfor- 
ward questions to answer. 

Example: Experimental Group 

The students in this group were shown a scrambled picture 
for this activity, with all the same objects that had appeared in 
the original picture, but now all in different places (the dog on 
top of the house, the plane under the tree, the car behind the 
house). By selecting the correct answer to a multiple-choice 
question, the student makes the object appear in its correct 
locat ion. 



El carro debe estar,.. [the car should be...] 

a. ...detras de la casa [behind the house! 

b. ...delante de la casa [in front of the house] 

c. ...encima de la casa [on top of the house]" 

Example: Control Group 

The students are shown the same picture as before, and asked 
to select the sentence which describes the correct location of 
each object: 

I . El carro esta... [The car is...] 

a. ...detras de la casa [behind the house! 

b. ...delante de la casa [in front of the house! 

c. ...encima de la casa (on t"op of the house] 



Dax^Z 

Hypothes is: 
New Item: 
Rev lew: 

New vocab: 



Meaningf u 1 pract Ice vs . manipulat I ve pract ice 

Stem-changing verbs in the reflexive 

Reflexive ME/TE/SE 

Non-reflexive stem-changing verbs 



divertirse 
despertarse 



d i vert ido 
rapldamente 
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Teaching strategy: 

The hypothesis being tested here is meaningful practice 
vs. communicative practice. The format of the follow-up practice 
Is varied for the two groups (questions on meaning vs* drill on 
forms). Note that in designating the practice here as 
••meaningful rather than "communicat ive** we are following the 
distinction made by Paulston (see Section 1.2). 

Experimental group: New forms and vocabulary are presented 
by means of a dialog between schoolmates regarding the problem 
one of them is having; he keeps falling asleep in the algebra 
class. The dialog is accompanied by the usual visuals to aid 
comprehension. There follows a brief tutorial on the forms of 
stem-changing verbs, including a review practice on stem-changing 
forms which the students had already studied. The final practice 
consists of a set of true-false comprehension questions based on 
the communicative content of the passage. 

Control group: The same forms and vocabulary are presented 
by means of uncontextual ized sentences accompanied by visuals. 
Following the tutorial practice (as abrve), students are given 
a manipulative drill (no choice of verb) on the stem-changing 
verbs from the sentences. 

While the above presentation is somewhat similar to Day 4 
(Integrated vs. non-integrated sentences), the format of the 
follow-up practice differs as noted above, (questions on meaning 
vs. drill on forms) . 

Example : Experimental Group 

••Roberto: Tengo problemas con mis clases. 
Ros i : TQue" pasa? 

Roberto: Me slento en la clase de algebra, y !pum! !me 
duermo ! 

Rosi: !Te duermes ea la clase! 

Roberto: Sf. Me despierto al final, cuando termina la 
clase . " 



[ Translat ion : 
Roberto : 
Rosi : 
Roberto: 

Rosi : 
Roberto: 



I'm having problems with my classes. 
What's the matter? 

I sit down in algebra class, and boom! I fall 
asleep . 

You fall asleep in class! 

Yes. I wake up at the end, when the class is 
over. ] 



Example: Control Group 

"Me siento en la clase de espanol. 
"Roberto se acuesta en la cama . ** 
*Tu no te duermes en la clase.** 
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• "Me dlvlerto mucho en la clase de muslca," 

"Yo me acuesto a IcS doce," 

[Translat Ion: 

"I sit down In Spanish class," 
"Roberto goes to bed In his bed." 
> "You don't fall sleep In class. 

"I have a good tltr.e In music class." 
"I go to bed at twelve."] 



Hypothesis; Answer- j udg Ing hypothesis 3 (program-controlled 
feedback vs. student-controlled help) 

New Item; Regular preterite <-AR): singular only (non-reflex- 
I Ive) 

New vocab; biclcleta anoche belsbol 

cenar conversar gastar 



Teaching strategy: 

All groups: Regular preterite forms are first Introduced by 
means of a tutorial which points out the various forms and 
elicits responses from the students to confirm their understand- 
ing of and attention to these forms. The past tense forms are 
then practiced In a reconstruction activity Involving the 
extraction of Information from a chart, followed by question and 
answer practice In which the student must type In a complete 
sentence. The program checks for mistakes either In the form of 
the preterite verb or the sense of the sentence • 

Four different types of feedback are used when the student 
makes a mistake* differing primarily In the amount of control the 
student has over the type of help that Is given: 

Group 1: No help - programmed correcxt answer. 

The program gives the correct answer and Instructs the 
student to type It In again. 

Group 2: Total program-controlled help 

The program automatically displays a help screen with 

hints related to the type of error the student has made; after 

looking at this screen* the student may try again. 

Group 3: Combined program and student-controlled help 

After each mistrial* the student may try again without help or 
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seek help by pressing the "escape** key. After the student 
requests help, the program automatically calls up the help screen 
pertinent to the particular error made, and allows the student to 
retype the response again. 

Group 4; Total student-controlled help 

The student may try again/ or seek help by pressing the "escape" 
key, which calls up a "help menu." From this menu students may 
then choose the type of help screen they feel they need — 
e*g. Do you want to review the vocabulary? the grammar? the story 
etc. — - and retype the response again. 

SAMPLE INFORMATION CHART 



"Tu" Susie 



escue la 


Montera 


McChesney 


la hora 
que cena 


a las 6 


a las 5:30 


re fresco 
que toma 


Coca-Cola 


Pepsi 


gasta el 
dlnero 


en la 
t lenda 


en el cine 


estudla 


esparto 1 


matemat leas 


act 1 V Idad 
el sabado 


V Is Ita 
con amlgos 


traba^a 
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Sample questions based on chart: 
[Practice on verbs In the preterite] 

1. ?Que tomaste tu^ayer? [What did you drink yesterday?] 

2. ?A que hora ceno Susie? [What time did Susie eat dinner?] 

3^ ?Qulen estudio en Montera ayer? tWho studied at Montera 
yesterday?] 

4. ?Donde gasto Susie el dlnero ayer? tWhere did Susie spend her 

money yesterday?] 

5. ?A que hora cenaste tu ayer? tWhat time did you eat dinner 

yesterday?] 

Vocabulary Screen for Day 9 

cenar to eat dinner 

conversar to talk 

estudlar to study 

gastar to spend 
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termlnar 
tomar 



to finish 
to drinks take 
to work 
to visit 



trabajar 
vis I tar 



anoche 
a^er 



be Isbol 
biclcleta 
d l ne r 0 
re fresco 



last night 
yesterday 
basebal 1 
bicycle 
money 

soft drink 
Saturday 
late 
store 



s^bado 
tarde 
t ieada 



Sample of Helpscreen: 

(The question appears with its English translation), i*e* 

"?Que tomaste tu ayer? 

What did you drink yesterday?" 

Helpscreen with "yo* CI] verb forms: 

La forma "yo" de los verbos en el preterito: 

cene 
estudle 
gaste 
tome ^ 
trabaje 
V is I te 

Helpscreen with "el/ella" [he/she] verb forms: 

La forma "el/ella" de los verbos en el preterito: 

ceno 

estudlo 

gasto 

tomo 

trabajo 

visits' 



HELP MENU [Available only to Group 4] 

1. Explain the vocabulary 

[If this is selected, the vocabulary screen for 
the day appears* ] 

2. Explain the question 

[If this Is selected, helpscreen which gives 
English translation appears.] 
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3. Show me the -yo* verb forms 

[If this is selected/ the helpscreen which shows 
all the "yo- <I) forms of the day's verbs 
appears • ] 

4. Show me the •"cl/ella* verb forms 

tif this is selected/ the helpscreen which shows 
all the "el/ella" (he/she) forms of the day's 
verbs appears . ] 



Hypothesis: Choosing passage from menu vs. no choice of passage 



New item: 

Revi<?w: 
New vocab: 



Regular preterite of -AR verbs (plural torms> 
reflexive (for recognition only) 



Regular preter i te of 
Story 1 Story 2 



-AR verbs (singular forms) 
Story 3 Story 4 



concierto 
incluso 
escenar io 
cane ion 



cue va 
cane i on 



ci ta 
incluso 
torre 
cane I on 



piscina 
toal las 
cane i 6n 



Old -AR verbs common to all 4 stories: 
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bajar 

cantar 

tocar 

Teaching strategy: 



llegar 

mirar 

tomar 



pasar 
sentarse 



Experimental group: From a list of four story titles, 
students choose the one they wish to read. This choice will 
determine not only the passage itself* but the particular version 
of the rest of the lesson they will see, since other activities 
are based on sentences from the passages. However^ the stories 
and activities are parallel for both broups. 

Control group: Students read the passage assigned. 

Both groups: Students are given a tutorial lesson, using 
sentences from the assigned reading^ on the plural forms of the 
preterite. They then read through the passage ltself> following 
which they are asked a series of true-false comprehension 
questions about the reading. 



Example : Experimental Group 
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••In this exercise you will read a story In the past tense 
and then answer questions about It* 

First, you get to choose the story. Read through the 
following titles, then select by typing the number of the one you 
want to read. 

1 Un conclerto de "rock" [ A rock concert] 

2 Cuatro "yanquls" en Madrid [Four yankees In Madrid! 

3 Ml prlmera clta [My first date] 

4 Una semana en HawaTI" [A week In Hawaii! 

[After student selects story number, the vocabulary screen, and 
questions given to that student will relate specifically to that 
story. ] 

EKaaple: Control Group 

[Automatically gets the second reading, "Cuatro yanquls en 
Madrid." ] 

Hypothesis: Answer-judging hypothesis 4: Implicit vs. explicit 
correct Ion 

New ltef^*^ Reflexive with NOS; preterite reflexives (new 
conblnat Ion) 

New vocab: ayer carapada conversar 

ducharse fue de prlsa 

tan 

Teaching strategy: 

Both groups: This exercise consists of a version of the 
game known as "Mad Lib". In this game, certain words are 
elicited from the students out of context, then are later 
Inserted by the program Into a "story". The result Is a silly, 
often humorous, reading. All students contributed vocabulary as 
prompted by the computer, then were given tutorials focusing on 
the forms of the relexlve with NOS and the use of the reflexive 
In the preterite. Finally, students completed a cloze exercise 
In which the passage was reconstructed by filling In blanks for 
missing words. Feedback on this final exercise was given In two 
different forms, one explicit, the other Implicit: 

Example: Mad Lib 

"Pretend you are In summer camp and you're writing a letter to 
your parents. In fact, the computer will write It for you all 
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you have to do Is give It a few words. 

For each number below> type in one word (en espanol, claro!) ac- 
cording to the directions given. 

1. plural nouti 

2. number (spelled out) from 2 to 5 

3. something to drink 

4. something to eat 
5- a room in a house 

6. articles of clothing (plural) 

7. a sport 

[Reading passage — the letter — computer automatically inserted 
the word selected above by the student for each space with a 
number below] 

Queridos mama y papa, 

Ayer mis hermanos y yo pasamos el primer dfa en la campada. 
Es un lugar muy Interesante, con muchos/as {1). 

Esta manana mis hermanos se levantaron tarde> pero yo me 
levant^ a. las (2). El director preguntoi "Juan, ?por que te 
levantaste tan temprano? ?Te acostaste muy temprano anoche? 
"Sf," conteste de prlsa. 

Luego nos duchamos con {3)> y nos llmplamos los dlentes con 
(4). Ml amlgo Carlos se pelno con (6), y comenzanos a Jugar al 
{7} en el {5}. 

Group 1: Explicit 

On the first mistrial, the student's error is highlighted on 
the screen, followed by, "No es correcto. Intenta otra vez." 
(Not correct, try again.) On the second mistrial, the correct 
answer Is explicitly modelled and the student tries again, such 
as : 

Program: What did he do? 

Student: He waked up. 

Program. No, HE WOKE UP. Try again* 

On the third mistrial, the correct answer Is given again. 

Gro^up 2: I mpl Id t 

On the first and second mistrials, the student's error Is 
highlighted on the screen, and a question appears which Implicit- 
ly models the correct form In a communicative manner, such as: 
Program: What did he do? 
Student: He waked up. 
Program: Who did you say woke up? 
Student: (new response) 

On the third mistrial, the correct answer Is given. 
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APPENDIX C: SAMPLE ACHIEVEMENT TESTS 
ACTIVITY DAY 9, TEST 1 

Part I. Comprehens lon/product loa <«ixecl> 
Conplete each sentence in Spanish 
with the CORRECT FORM of one of the 
verbs beneath the sentence. 



1. Nosotros una semana en Me'xico 

el ano pasadc. 

tocar pasar llegar 
[1. We a week in Mexico last year. 

to play (an Instrument) to spend to arrive] 

Escribe el verbo aquf: 

(if {pasamos) then) Muy bien, 
(Otherwise) Lo slento. 



2. Ayer los chicos canclones bonltas. 

m 1 rar tonar can tar 

[2. Yesterday the children beautiful songs 

93 



105 



to look at to take to sing] 

Escribe el verbo aqufj 



(If (cantaron) then ) Muy blen. 
(otherwise) Lo slento 



3- HiS amlgos a la escuela en el 



autobus esta manana. 



llegar tomar tocar 

[3, My friends ^ at school in the bus this morning. 

to arrive to take to play (an Instrument)] 
Escribe el verbo aquT: 



(If (Uegaron) then ) Muy blen. 
(otherwise) Lo slentc. 



4. Nosotros ^ del autobus al final 

del vlaje. 

llegar bajar mlrar 

(4. We the bus at the end of the trip. 

to arrive to get off to look at] 
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Escribe el verbo aquft 

(if (bajamos) then ) Muy bien. 
(otherwise) Lo siento. 



5. Nosotros muchas canciones en la 

fiesta el sabado pasado. 

tomar mlrar cantar 

t5. We many songs at the party last Saturday. 

to take to look at to sing] 

Escribe el verbo aquf: 

(if (cantamos) then ) Muy bien, 
(otherwise) Lo siento. 



6. Muchas personas guitarras en la 

fiesta mexicana. 



tonar tocar cantar 

t6. Many people guitars at the Mexicaa party. 

to take to play to sing] 
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Escribe el verbo aquf^t 

(if {tocaron} then ) Muy bien. 
(otherwise) Lo siento. 



DAY 9, TEST 2: Discrete/recognition 

Match each sentence with the LETTER of 
the word which best fits the blank. 



!• Podemos nadar en la... 

a. cita b. piscina c. cueva 
t 1 . We can swim in the 

a . date b. pool c . cave ] 

Escribe la letra aquf: 

(if (b) then) Muy bien. 
(otherwise) Lo sieato. 
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2r Lo9 dos jovenes tlenen una ... para Ir 
al clner 

a. cueva b. cancl^n c. cita 
C2. The two young people have a for the movie, 

a. cave b. song d. date] 

Escribe la letra aquT: 

(if (c) then) Muy bien. 
(otherwise) Lo slento. 



3» Los chlcos ... un refresco en el cafe. 

a. tomamos b- tocaron c. tomaron 

[3. The boys a soft drink in the cafe. 

a. (we) drank b. (they) played c. (they) drank! 

Escribe la letra aquf: 

(if (c) then) Muy bien. 
(otherwise) Lo s lento . 



4. ?Puedes can tar una ... para nosotros? 
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a. cane ion b. cantante c. nacion 

[4. Can you sing a ^ for us? 

a, song singer c. nation] 

Escribe la letra aquf*: 

(if (a) then) Muy bien. 
(otherwise) Lo siento. 



5. Todos nosotros ... la television ayer, 

a. miraron b. empezaron c. miramos 

[5. We all television yesterday. 

a. (they) watched b. (they) began c. (we) watched 

Escribe la letra aqu T: 

( i f {c} then) Muy bien. 
(otherwise) Lo siento. 



B. DAY 10, TEST 2 
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Part I J Integrative/recognltion 

In the following exercise^ choose the 
version of each sentence which seems 
most 1 ikel y . 

Toca RETURN 



1. Ayer por la manana... 

<a) . . .nos levantamos a las tres, 

(b> ...nos levantamos a las sels. 

(c) ...nos levantamos a las doce. 
tl. Yesterday nornlng... 

<a) . . . we got up at 3. 

<b) . . . we got up at 6. 

(c) ...we got up at 12.] 

Escribe una letra <a-c)t 

(If (b) then) Sf, es logico. 
(otherwise) ?c6mo? Otra vez. 



2. (a) Me duche con agua. 

(b) Me duche con Coca-Cola. 

99 



<c) Me duche' con leche. 

t2. <a) I showered with water. 

<b) I showered with Coca-Cola. 

<c) I showered with milk.] 

Escribe la letra <a-c): 

(if {a} then) Sf, es logico. 
(otherwise) ?c6mo? Otra vez. 



3. Ayer nos qui tamos la ropa... 

(a) ...despues de tomar un bano . 

(b) ...antes de tomar un bano. 

(c) ...antes de cenar. 

(3. Yesterday we took off our clothes... 
(a) ...after taking a bath. 
<b) ...before taking a bath. 
<c) ...before eating dinner.] 

Escribe una letra <a-c): 

(if {b} then) Sf, es logico. 
(otherwise) ?Como? Otra vez. 
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4. Ayer por la tnanana wis hermaao3»ii 
<a) ...se quitaron los dientes. 
(b) ...se afeitaron los dientes. 
<c) ...se llmplaron los dientes. 
[4. Yesterday worning my brothers... 
<a) ... took off their teeth. 
<b) ... shaved their teeth. 
<c) ... cleaned their teeth.] 

Escribe una letra <a-c): 

<if {c} then) sC es logico. 
(otherwise) ?Como? Otra vez. 



5. (a) Mi amigo se peino el pelo. 

<b) Mi amigo se quite el pelo. 

(c) Mi amigo se acosto el pelo. 

[5. <a) My friend combed his hair. 

(b) My friend took off his hair. 

<c) My friend put his hair to bed.] 

Escribe una letra <a-c) : 

(if {a} then) sf, es lo^gico. 
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(otherwise) ?Como? Otra vez. 



6. Esta maffana el director pregunto.,, 
(a) ?A que hora te levantaste anoche? 
<b) ?A que hora te acostaste anoche? 
<c) ?A que hora te despertaste anoche? 

[6, This morning the director asked, 

(a) What time did you get up last night? 

(b) What tine did you go to bed last night? 

(c) What ti»e did you wake up last night?] 

Escribe una letra <a-c): 

(if (b) then) sf, es logico. 
(otherwise) ?Como? Otra vez. 



DAY 10> TEST 2: Discrete/production 

Cowplete each sentence with the CORRECT 
FORM of one of the verbs beneath the 
sentence . 
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1. Esta manana yo wuy t^wprano. 

acostarCs'- > despertarCse) qultar<se) 

tl. This morning I very early 

to go to bed to wake up to take off] 

Escribe la respuesta aqu T: 



(if (me desperte} then) Muy blen. 
(otherwise > ?Como? 



2. Ayer los chlcos no los dlentes. 

li»piar(se) qu itar(se) acostar(se> 

12. Yesterday the boys didn't their teeth 

to clean to take off to go to bed] 

Escribe la respuesta aquf: 

(if (se limplaron} then > Muy bien. 
(otherw Ise) ?Co»iO? 



3. Nosotros con agua callente ayer, 
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despertarCse) quitar<se ) banar <se ) 

[3. We with hot water yesterday. 

to wake up to take off to bathe] 

Escribe la respuesta aquf: 



<lf (nos banamos} then ) Muy bien, 
(otherwise) ?Como? 



4. El director ntuy temprano esta 

manana • 

1 ittpiar<se) levantar<se) qultar<se) 

[4. The director very early this worning, 

to clean (oneself) to get up to take off] 

Escribe la respuesta aquf; 

<if {se levanto) then ) Muy bien. 
(otherwise) ?c6mo? 



5. Nosotros muy tarde ayer por la 

104 



ERIC 



116 



noche despues de la fiesta, 

levantarCse ) despertarCse ) acostarCse ) 
[5*- We very late last night after the party, 

to get up to wake up to go to bed] 

Escribe la respuesta aqut: 

<lf (nos acostaiios) then ) Muy blen. 
(otherwise) ?Como? 



6, Jaime la ropa para banarse, 

afeltar<se) qultarCse) ducharCse) 

[6. Jim his clothes to take a bath. 

to shave to take off to shower] 

Escribe la respuesta aquf: 

(if (se qulto) then ) Muy blen- 
(otherw Ise ) ?Coino? 
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APPENDIX D 



POST TEST PLEASE PRINT: 

YOUR hJAME: 

TEST TYPE; Discrete /recognition clastT ~ (first)" 

I. Mark an X through the NUMBEP of the iterns below which would 
normally be found in a bathroom. 'For ejfample, if you choose 
#17 ?« 18: ^ ^) 



1. 


pei 


1. 


jamon 


13. 


espejo 


2. 


gafas de sol 


8. 


champu 


14. 


arbol 


2. 


af ei tadora 


9. 


el ef ante 


15. 


cane ion 


4. 


jabon 


10. 


champ an 


16. 


c i 1 1 o 


5. 


piscina 


11- 


toalla 


17. 


pelota 


6. 


sop a 


12- 


agua 


IS. 


pr isa 



TEST TYPE; Integrated recognitcon 

II. Mark an X through the LETTER of th^ sentence 
that best ANSWERS each question. 

1. ^Te levant as a las 6? 

a. Yes, I get up at S. 

b. Yes, you sit down at G. 

c. Yes, I sit down at 6. 

d. Yes, you get up at S. 

2. ^ Se mira Ud. en el espejo? 

a. Yes, he sees himself in th^ iviirror. 

b. Yes, I look in the cabinet. 

c. Yes, he looks in the cabin-et. 

d. Yes, I look in the mirror. 

3. ^ Te acuestas en el museo? 

a. No, he doesn't sit down in the music room. 

b. No, you don't go to bed in the museum. 

c. No y I don ' t sit down in the mus i c r oom • 

d. No, I don't go to bed in the museum. 

4. ^ Se duernien los profesores en la clase? 

a . No y t h e t eac h er s don b dan c e in c 1 ass . 

b. No, he and his teacher don't argue in class. 

c . No, the teachers don ' t f al 1 itsl e-^p in c lass. 

d. No, you and your teachttp^ don't dance in class. 
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BEST COPY AVAILABLE 

5, ^Te afeit^s en el cuarto de baPfo"^ 

a. Yes, I wash myself in the bathroom. 

b. Yes, you shave in the bathroom. 

c. Yes, you wash yourself in the bathroom. 

d. Yes, I shave in the bathroom. 

6. ^ Comen Uds. en el comedor? 

a. Yes, we eat in the kitchen. 

b. Yes, you eat in the kitchen. 

c. Yes, we eat in the dining ro 



Page 2 



- dining room, 

you eat in the kitchen. 



8, ^ Se limpian Uds. el pelo con champu? 

a. No, we don't wash our dog with shampoo. 

b. Yes, you wash your hair with champagne. 

c. Yes, you wash your dog with shampoo. 

d. Yes, we wash our hair with shampoo. 



TEST TYPE: 
lii. Al 



Discrete recognition 



THE RTlSFmjF FHE LISTS, Mark an X through the LETTER of 
the English word that matches each Spanish word, USE ONLY THE 
RIGHT-HAND COLUMN for each answer. For eycample, if l."vanidoso" 
matches b. "angry", your answer would be: 

1. a^cdefg 



1. 


va^idoso 


a. 


happy 


1. 


a 


b 


c d 


e 


f 


g 


2. 


sueter 


b. 


angry 




a 


b 


c d 


e 


f 


g 


w • 


rapidaniente 


c . 


vain 


3. 


a 


b 


c d 


e 


f 


g 


4. 


feliz 


d. 


sweater 


4. 


a 


b 


c d 


e 


f 


g 


5. 


barba 


e. 


quickly 


5. 


a 


b 


c d 


e 


f 


g 






f . 


swear 




















9- 


beard 
















6. 


medi anoche 


a. 


student 


&. 


a 


b 


c d 


e 


f 


g 


7. 


car ro 


b. 


midni ght 


7. 


a 


b 


c d 


e 


f 


g 


8. 


arbol 


c • 


carrot 


8. 


a 


b 


c d 


e 


f 


g 


9. 


est udi ante 


d. 


noon 


o 

• 


a 


b 


c d 


e 


f 


g 


10. 


chiste 


e. 


tree 


10. 


a 


b 


c d 


e 


f 


g 






f . 


car 




















g. 


Joke 
















IK 


cuchi 1 lo 


a. 


face 


11. 


a 


b 


c d 


e 


f 


g 


12. 


cane i on 


b. 


f r i end 


12. 


a 


b 


c d 


e 


f 


g 


13. 


cara 


c • 


kni f e 


13. 


a 


b 


c d 


e 


f 


g 


14. 


pi jama 


d. 


sleepwear 


14. 


a 


b 


c d 


e 


f 


g 


15. 


ami go 


e. 


page 


15. 


a 


b 


c d 


e 


f 


g 



f. 

g. 



car 
song 
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TEST TYPE; Discrete recognition ^ 

IV. Mark an X through tho letter of the. sentence which best 
ANSWERS #ach question... 

1. dSu papa se afeita por la mafVana? 

a. Stf te afeitas por la maPfana. 

b. Stf lo afeito por la maPfana. 

c. Sif se afeita por la maWana, 

2. <}Te sientas en el autobCis publico? 

a. No, no me siento en el autobCTs pCiblico. 

b. No, no te sientas en el autobus publico. 

c. No, no me sientas en el autobiis publico, 

3. ^Se divierten Uds. el sabado? 

a. SCf se divierte el sabado. 

b. Sff nos divertimos el sabado. 

c. SCf nos divierten el sabado, 

4. eSe pelnan las chicas por la mafVana? 

a. Sf, se peinan. 

b. Sf, las peino. 

c. SCf me peinan. 

5. 6Te despiertas muy temprano? 

a. sCf te despiertas muy temprano. 
fa. sp te despierto muy temprano. 
c. Sif me despierto muy temprano, 

&• dComo se llama su actor favor i to? 

a. Se llama Harrison Ford. 

b. Me llamo Harrison Ford. 

c. Se llamas Harrison Ford. 

^ through the LETTER of the sentence whicf7MAKErTHE 

nUol SENSE. 

TEST TYPE; Integrated recognition 

a. Me acuesto cuando te afeitas, 

b. Te lavas cuando te levantas, 

c. Me limpio con champu cuando me levanto. 

2. 

a. Te sientas en la sopa cuando te acuestas. 

b. Te pones el pijama cuando te acuestas. 

c. Te pones los dientes cuando te acuestas. 
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a. Los muchachos vary al comedor en el autobils publico. 

b. Los muchachos van a la escuela en el autobus publico, 

c. Los muchachos van al abrigo en el autobus publico. 



a. En la •scuela, los 

b. En la escuela, los 

c. En la escuel a , los 



estudi antes 
estudi antes 
estudi antes 



se llaman. 
estudi ari- 
se levantan. 



7. 



e. 



9, 



a. Par la noche, los chicos se ponen los dientes. 

b. Par la noche, los chicos se cepillan los dientes, 

c. Par la noche, los chicos se quitan los dientes. 

a. Par la noche, Roberto y Luis se levantan. 

b. Par la noche, Roberto y Luis toman el desayuno. 

c. Por la maPrana, Roberto y Luis se levantan. 

a. Las chicas se llaman Marxa y Carmen. 
D. Las chicas se llaman la escuela, 
c. Las chicas se bafYan Mar fa y Carmen. 

a. Profaablemente me baWo con Jabob. 

b. Probablemente me baWo con sopa. 

c. Probablemente me baPfo con Jamon, 



a. Te afeitas el pelo con champu. 
•b. Te limpias con champu. 
c. Te lavas- el pelo con champu. 



a. Me limpio los dientes cuando me levanto. 

Te limpias los dientes cuando me siento. 
c. Me limpio los dientes cuando me pongo el abrigo. 
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TEST TYPE; Discrete production p^q^ 5 

VI. Write in Spanish the opposite of the word or phrase below, 
!• dormirse 

2. encima de 

3. detras de _ _ 

4. acostarse 

5. agua fria 

B. ponerse 



TEST TYPE : Discrete S integrated" production 

yil. Complete each sentence with the correct form of one of the 
verbs beneath the sentence. 

^' una semana en Mexico el afVo pasado. 

tocar pasar llegar 

2. Ayer mi amigo canciones bonitas. 

mirar tomar cantar 

^ ^ la escuela en el autobus ayer. 

llegar tomar tocar 

4. Susana del autobus a-l final del viaje. 

llegar bajar mirar 

^' Coca-Cola ayer en la fiesta. 

tomar mirar cantar 

^ la guitarra ayer en la fiesta. 

tomar tocar cantar 
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BEST COPY AVAILABLE 

T E ST T YPE ; Integrated produetion Pag'& 6 

VIII. For each blank in the following story, write the appropri- 
ate verb in the space .provided at the ^nd . This is a story about 
like Jh^S?) everything the opposite! (Do you know anyone 



PEPE EL LOCO 

P-n^ si^mpi-e me despierto a las seis de la maftana. Mi amigo, 

'^^'P^*-: CiJ a las nueve. Pepe siempre dice, "Tu, Manuel. 

t;r. T ^° -ontesto, "Pepe, tCT e;es rWloco! 

.Yo me despierto muy ternprano, pero tu __ (2) _ muy tarde'" 

v« "'^^P*' ^i-^s muy loco. Te duermes" en el sofa. 
<3) en la cama. " 

-.^n^f?* verdad mi amigo Pepe es muy loco. Yo me pongo los 
zapatos para ir a la escuela. Pepe no _<4) los 

77r • "^f ^^9°' "Pepe, eres muy loco. JPor~que tu 

los zapatos para ir a la escuela? 

Tambien yo me divierto el sabado, pero Pepe nunca 
ei""MUY locoT""' '^''^^^■^^ siempre. iPepe es mi buen amigo, pero 

ANSWERS: 
'1. 



— 6. 

4. 



TEST TYPE; Discrete production 

's^^iry?r'' """^ following questions. (They are NOT about the above 
!• Estudiaste ayer? 



2. Trabajaron ustedes el dorninqo? 



3. Ceno Jose" con tu familia ayer? 



4. Desayuno usted mucho hoy? 
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Page 7 

5. iConv&rsaron ustodes con el Presidente Reagan ayer? 



6* ^Tomaron champSn los ni%os ayer? 



X. Read the following paragraph. 
TEST JYPE: Discrete recognition 

kstamos en la caia de un mexicano. La persona se llama 
Pedro LSpez. Pedro trabaja mucho por la noche. Por eso, se 
levanta muy tarde. Pedro se levanta a las once de la maPfana. Va 
al cuarto de bafto. Pedro es muy vanidoso tamfaien. Por eso, se 
mira en el espejo mucho. El tiene barba. Se afeita con una 
afeitadora electrica. 

Now, answer the following quest i^-is about the paragraph. Use 
COMPLETE SENTENCES. 

1- ADonde estamos? 



2. d'A que hora se levanta? 



3. iQue tiene el? 



4. * d'Que hace con una afeitadora electrica? 
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Pago S 



cSmnlfJj Jh^^^^gh the LETTER of the word or phrase which best 
completes the sentences about the story. 



5. Pedro Lopez gets up . . . 

a. early 

b. lato 

S. Pedro Lopez works ... 

a. a little 

b. a lot 

7. Pedro gets up at... 

a. eleven o'clock 

b. one o'clock 

c. six o'clock 



8. Pedro looks at himself a lot in the mirror because,.. 



a. he is happy 

fa. he is worried about pimples 
c. he is vain 



TEST TYPE; Integrated recognition 

mo4t"sense? ^ ^''^^^^^^ ^^TTER of the sentence which makes the 



1 . Ayer . . . 

a. nos levantamos a las tres. 

b. nos levantamos a las seis. 

c. nos levantamos a las doce. 

2 a. Me duche con agua. 

b. Me duche con Coca-Cola. 

c. Me duche con el impermeable. 

3. - Nos limpiamos los dientes... 

a. con champu. 

b. con Jabon. 

c. con crema dental, 

4. Anoche Jaime. . . 

a. gasto mucho dinero. 

b. gasta mucha comida. 

c. gasto mucha comida. 

5. Anoche mis amigos. 

a. miraron la television. 

b. miran la television. 

c. gastaron la television. 

6. Ayer por la noche, tu. . . 

a. llamas a tu mama. 

b. llamaste a tu mama. 

c. quitas a tu mama 
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T E ST T YPE : Discrete recognition Page 9 

XII. Mark an X through the LETTER of the best TRANSLATION for 
each English phrase below. 

!• I studied. 

a. #studias 

b. ^studie 

c. estudiaste 

2. Ue worked. 

a. trabajamos 

b. trabajaron 

c. trabajo 

4. We combed our hair 

a. nos pei names 

b. nos peinS^ 

c. nos peinan 

5. Juanita sat down. 

a. se sentaron 

b. se sienta 

c. se sento 

6. We washed ourselves 

a. nos la van 

b. nos lavamos 

c. nos lavaron 
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APPENDIX E- 

The Pinsleur Language Aptitude Battery (PLAB), developed for 
use in Grades 7-12, containes five subtests to assess different 
aspects of language aptitude. These subtests and a description of 
the specific ability <ies) each is designed to test are as 
follows (Pimsleur, 1966). 

1. Interest in learning a foreign language: designed to 
give an indication of a student's »otivaticn_ 

2. Vocabulary: word knowledge in English; designed, along 
with the next section on language analysis , to 
provide information regarding a student's verbal 
ability and his ability to handle the Kechanics of a 
foreign language. 

3. Language analysis: ability to reason logically in 
terms of a foreign language. 

4. Sound discrimination: ability to learn new phonetic 
distinctions and to recognize them in different 
contexts; designed to test the student's ability to 
hear and retain new sounds. 

5. Sound-symbol association: an association of sounds 
with their written symbols; designed to measure a 
student's ability to associate Engl Ish-lanuage sounds 
with their written symbols. 



* Extracted from Robinson, 1981 

In the present study only subtests 2-5 were used. 
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BM 805 ANSWER SHEET 

PIMSLEUR 

EWMnt . LANGUAGE APTITUDE 



FORM S 

SIDE 1 



KAMB: 



Teachec_ 



BATTERY 



PART 1 GRADES IN MAJOR SUBJECTS " 

Ari(h«*Mith. Grade 

I 



l>-*S'pBCCS t. 2 

C-Sptctj 1. 2, 3 
B-Sp«eti I, 2,3,4 
A-Sp«ccj 1, 2, 3, 4. 5 



□ 



Science Grade 



n 



li/l- Spue I 
f>-Sp*ccs I. 2 
C-Sptcci I. 2. 3 
B— Spico I, 2. 3. 4 
ASpues 1.2.3. 4,5 



E/F-Spicc I 
D— Spaces I. 2 
C— Spiccj I, 2. 3 
B— Spieci I, 2, 3, 4 



I 

j. B/F-Sp*ce I 
2 



D— Spicci I. 2 
O-Spices 1. 2, 3 
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PART 2 INTEREST 



We would like you to give an estimate of how interested you arc in 
studying x modem foreign Uxiguage. In making this estimate, ask your- 
self bow useful a foreip language wiU be to you, how much you will en- 
joy it. and how interested you arc in foreign languages as compared with 
other subjects. 

Take time to think over your answer; then indicate your interest in 
studying a modem foreign language. 



Rather uaintcrested --Space 1 

More or less indifferent— Spaces 1, 2 

Mildly interested —Spaces 1, 2. 3 :: 

4 

Rather interested —Spaces 1. 2, 3. 4 j- 

5 

Strongly interested —Spices 1, 2, 3. 4. 5 



ERIC 



PART 3 


VOCABULARY 










PART 4 


LANGUAGE 


PART 5 


SOUND DISCRIMINATION 






















ANALYSIS 






























a 


b 


c 


d 


cabin 


boa 


cabin 


boa 


friend 




















1 ^ 








1 jj 




16 jj 
cabin 














SAMPLE 


a 

it 


b . 


.C 


d 

1 




e 


f 




h 


cabin 


boa 


boa 


friend 












-ill 






2 h 








2 :j 




17 jj 
























a 


b 


c 


d 


cabin 


boa 


cabin 


boa 


friend 




















3 








3 jl 




18 l 






a 

1 


b 


c 


d 




a 


b 


C 


d 


e 


f 


it 


h 


cabin 


bos 


cabin 


boa 


friend 








13 










4 ; 






4 jj 




19 ;i 






c 


f 


5 


h 




e 


f 




h 


a 


b 


c 


d 


cabin 


boa 


cabin 


bca 


friend 


2 








24 








5 








5 p 




20 jj 






a 


b 


c 


d 


15 


a 


b 


c 


d 


e 


r 


S 


h 


cabin 


boa 


cabin 


boa 


friend 


3 - 
















6 








6 : 




21 jj 






e 


f 




h 




e 


f 


S 


h 


a 


b 


c 


d 


cabin 


boa 


cabin 


boa 


friend 


4 \ 








16 










7 








7 I'. 




22 :j 




tt 


h 


c 


d 




a 


. b 


c 


*d 


e 


r 


S 


h 


boa 


friend 


cabin 


boa 


friend 


5 ^ 








17 










8 ;i 








8 ;: 




23 ;j 






e 


f 


jS 


h 




e 


f 


S 


h 


a 


b 


c 


d 


boa 


friend 


cabin 


boa 


friend 


6 jj 








18 










9 








9 i: 




24 f 






a 


b 


c 


d 




a 


b 


c 


d 


e 


f 


S 


h 


boa 


friend 


cabin 


boa 


friend 


7 








19 










10 








10 




25 j 






e 


f 


S 


h 




e 


f 




h 


a 


b 


c 


d 


boa 


fnend 


cabin 


boa 


friend 


8 :i 








20 










11 








11 ; 




26 






a 


b 


c 


d 




a 


b 


c 


d 


e 


f 


S 


h 


boa 


friend 


cabin 


boa 


friend 


9 








21 










12 








12 


27 :; 




c 


f 


S 


h 




e 


f 


$ 


h 


a 


b 


c 


d 


boa 


friend 


cabin 


boa 


friend 


10 ;j 








22 










13 








13 ;! 




28 ii 






a 


b 


c 


d 




a 


b " 


c 


d 


e 


f 


S 


h 


boa 


friend 


cabin 


boa 


friend 


11 d 








23 










14 








14 } 




29 .1 






e 


f 


S 


h 




e 


f 


S 


h 


a 


b 


c 


d 


boa 


friend 


cabin 


boa 


friend 


12 j: 








24 










15 








15 =: 




30 ij 






• 








PRINTCO IN 


U.S.A. 




IIM ^ORM U.S. nOO B 


77y4 


TURN TO SIDE 2 FOR PART 6 


► 



11 



6^128 BEST cSl'Y AVAILABLE 



BEST COPY AvrtiurtULi 



IBM 805 ANSWER Sirr^.T 
PIMSLEUR 

LANGUAGE APTITUDE 

BATTERY 



PART 6 SOUND-SYMBOL ASSOQATION 



FORM S 
SIDE 2 
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thorleg 
throve 
thurgle 
thr{)leg 
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snosfen 
soosfen 
snosnef 
sottsnef 



6 

ro&ktfag 
rokstrag 
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Ihurksle 
thruksle 
thruskie 
thurskic 
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vfnip 
«ffap 
afpar 
arpaf 
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tiksgel 
lipkel 
ttskgel 
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culther 
duther 
culhler ■ 
duthler 
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ntmbril 
mtnbirl 
ntmbirl 
mtnbril 
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woincr 
wonlncr 
wonicr 
wcnlnor 



10 

rtcli|5 
rigid 
ricgicl 
ridicg 
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tronbleg 
tombleg 
trolbncg 
torlbneg. 
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itiu/ordli 
inuryjiidli 
ii)U(lt)r/.It 
niariKl/Jj 
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chcblogc/. 
chcboglc7. 
chclbogcz 
chcUobcz 



20 

Hirilum 
Hririlum 
hirilnum 
Itrirtlnum 
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kriblultos 
krilbultos 
kirbiulios 
kirtbultos 
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da^kct 
calsket 
daksct 
calksct 
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lil&antcr 
fixlanter 
flslatner 
ftlslatner 
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safer kal 
sakerfal 
safekral 
sfikrefal 
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13 

widnt 
windt 
witnd 
wintd 



18 

krimsloder 
krtlsmoder 
kltmsroder 
klidsmoder 



23 

trazbtmen 
trambiun 
tranbimcz 
trazbmero 



14 

ntspcrdop 
iiapserdop 
napscprod 
ntspeprod 



19 

ntsfoshun 
nafsoshun 
ntshfosun 
nafshosun 



24 

(olandus 
todandlus 
totdandus 
toUndlus 
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APPENDIX F: 



What tine do you normally get up on a school day ? 

FREQUENCY 

(N> 



PERCENTAGE % 



6:30-7:00 =32 =50 % 

7:00-8:00 = 15 =23 % 

6:00-6:30 =10 = 16 % 

5:30-6:00 = 6 = 9 % 

5:00-5:30 = 1 = 2 % 

<64) 



What Is your favorite toothpaste ? 



Crest =30 =38 

Colgate = 16 =21 

Aqua Fresh = 15 = 19 

Aim = 14 = 18 

Close-Up = 2 = 3 

Topal = 1 = 1 

<78) 



Your favorite soft drink ? 

Coke =24 =32 % 

7 Up = 14 = 18 % 

Pepsi = 13 = 17 % 

Sprite = 6 = 8 % 

Root Beer = 4 = 5 % 

Cream Soda = 3 = 4 % 

<12) 2< other = 12 = 16 % 

<76) 

What does the typical Montera student (boy or girl, whichever 
applies to you) wear to school ? 

Jeans =28 =25 % 

Regular Shirt = 15 = 14 % 

Sweater = 13 = 12 % 

Clothes = 9 = 8 % 

Shoes = 8 = 7 % 

Jacket = 5 = 5 % 

Trendy Clothes = 5 = 5 % 

Pants = 5 = 5 % 

(11) 3< other =22 =20 % 

(110) 
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5. What do you wear when It ralr.s ? 



FREQUENCY 
<N) PERCENTAGE % 

Warm Jacket =22 = 19 H 

Nornal Clothes =21 = 18 % 

Sweater = 12 = 10 % 

Jeans = 12 = 10 % 

Rain Jacket = 6 = 5 % 

Big Coat = 5 = 4 % 

Shirt = 5 = 4 % 

Coat = 5 = 4 % 

Boots = 4 = 3 % 

Shoes = 4 = 3 % 

Umbrella = 4 = 3 % 

(12) 3< other =15 = 13 % 

(115) 



6. Nane two school subjects you are taking now. 

Spanish =32 =22 % 

Engl Ish =22 = 15 % 

Math =20 = 14 % 

Civlcs/Economlcs = 11 = 7 % 

Algebra = 9 = 6 % 

Geonetry = 7 = 5 % 

Public Speaking = 6 = 4 % 

Science = 4 = 3 % 

Gyn = 4 = 3 % 

(19) 3< other =33 =22 % 

(148) 



7. Your most difficult class ? 



Algebra =17 = 24 % 

Math =16 =22 % 

Spanish = 8 = 11 % 

Civlcs/Economlcs = 6 = 8 % 

History = 5 = 7 H 

English = 5 = 7 % 

(8) 2< other = 15 =21 't 

(72) 
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8. Your most Interesting class ? 



FREQUENCY 
<N) PERCENTAGE ^ 



Clvlcs/Econowlcs = 9 = 12 % 

English = 7 = 10 % 

Biology = 6 = 8 % 

Typing = 6 = 8 % 

Math = 5 = 7 % 

Spanish = 4 = 5 % 

Science = 4 = 5 H 

Algebra = 4 = 5 % 

(17) 3< other =28 =38 % 

<73) 



9. Name two electric appliances you think a typical American 
fa»ily night have in its kitchen ? 

Toaster - = 37 =25 % 

Microwave =26 = 18 \ 

Stove/Oven = 23 = 16 h 

Refrigerator = 19 = 13 % 

Blender = 12 = 8 % 

Food Processor = 6 = 4 % 

Coffee Maker = 6 = 4 % 

Mixer = 5 = 3 h 

Dishwasher = 4 = 3 % 

Electric Can Opener.. = 3 = 2 h 

<5) 2< other = 7 = 5 % 

(148) 



10 a. Name your favorite sports to play 



Football = 18 =21 % 

Basketball = 17 =20 % 

Baseball = 12 = 14 % 

Swinmiag = 7 = 8 % 

Soccar = 6 = 7 % 

Tennis = 5 = 6 % 

Vollyball = 3 = 4 % 

Gymnastics = 3 = 4 ^ 

<ll) 2< other = 14 = 16 k 

(85) 
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10 b. Naae your favorite sports to watch: 



(N) 



FREQUENCY 



PERCENTAGE % 



Football = 39 = 47 % 

Baseball = 13 = 16 % 

Basketball = 7 = 8 % 

Gymnastics = 6 = 7 % 

Swi»i»lng = 4 = 5 % 

Soccar > = 3 = 4 * 

Boxing = 3 = 4 % 

<7) 2< other = 8 = 10 % 

<83) 



11. What do you do on a Saturday afternoon ? 



With Friends = 14 = 15 % 

Movies = 10 = 10 % 

Shopping = 9 = 9 * 

Go out = 9 = 9 % 

Watch TV = 8 = 8 \ 

Sleep = 7 = 7 \ 

Hone work ..= 7 = 7 % 

Play Sports = 5 = 5 % 

Work = 4 = 4 h 

<20) 2< other =23 =24 % 

<116) 



12. If you could go anywhere^ 
visit ? 



where would you most like to 



Europe =23 = 27 % 

Hawal I = 16 = 19 % 

Australia = 10 = 12 % 

Carrlbean = 7 = 8 % 

Mexico = 3 = 3 % 

South America = 3 = 3 H 

<22) 2< other = 24 «28 % 

<86) 
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3 a. Who Is your favorite male actor/singer ? 



Eddy Murphy. . . . 
MALE Harrison Ford 
ACTOR Mel Gibson 

<19) 2< other. 



FREQUENCY 



<N) PERCENTAGE % 

= 13 =31 % 

. .= 3 = 7 % 

= 3 = 7 % 

.=23 =55 % 

(42) 



Prince =21 =46 % 

MALE Morris Day = 3 = 7 % 

SINGER Huey Lewis = 3 = 7 % 

<15) 2< other = 19 =41 % 

(46) 



3 b. Favorite female actress/singer ? 



Marylln Manroe = 5 = 16 % 

FEMALE Joan Collins = 4 = 13 % 

ACTRESS Meryl Streep = 3 = 9 h 

Karen Allen = 3 = 9 h 

(15) 2< other = 17 =53 % 

(32) 



Madonna = 13 =29 % 

FEMALE Shlela E = 9 =20 % 

SINGER Apalonla Kortero = 5 «11 % 

Roxanne ' = 4 = 9 % 

Cyndy Lauper = 4 = 9 % 

(9) 2< other = 10 =22 % 

(45) 



4. Which kind of stories Interest you rnost ( detective, science 
fiction, romance, other...) ? 

Romance... =23 =25 % 

Science-Fiction = 16 = 18 \ 

Mystery/Murder/Horror . = 16 = 18 h 

Detective = 10 = 11 % 

Fiction = 9 = 10 h 

Action/Adventure = 6 = 6 % 

Novels s 2 = 2 h 

(9) one per, other.... = 9 = 10 % 

(91 ) 
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15. What kind of probl«M-sol vlng activities would you be most 
Interested in solving < crosswords, riddles, mysteries. 



other) ? 



FREQUENCY 
(N) PERCENTAGE 

Mysteries = 37 =44 % 

Crosswords = 20 =24 h 

Riddles = 19 =23 % 

Finding Words = 2 = 2 % 

<6) one per, other... = 6 = 7 % 

<85) 



16. Which of the following topics would you probably be most 
interested in reading about ? 



A first date = 22 =31 % 

A week in Acapulco...= 9 = 13 % 

The superbowl = 8 = 11 h 

A trip in the space 

shuttle = 6 = 8 % 

A wierd dream = 6 = 8 % 

A neighborhood crime. = 4 = 6 % 

<13) 3< other = 17 =24 H 

<72) 



17. What aspects of Spanish culture do you like best ? 



Food = 31 =34 % 

DancesCing) = 10 = 11 % 

Way they talk = 4 = 4 h 

Lifestyle = 4 = 4 % 

Nothing 4 = 4 H 

Drinking age = 4 = 4 H 

Language = 3 = 3 h 

Clothing (dress) = 3 = 3 % 

<23) 2<, other = 29 =32 % 

<92) 
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APPENDIX G 
. TRANSCRIPT OF VIDEOTAPED INTERVIEWS: ^^ 

I. Interviews with Individual students while working in the 
computer laboratory (13 students) 

[Dr. Robinson talking with Sll 

SI - I talked with my parents, and I told them that I really 
liked this class a lot and I was learning a whole bunch, and I 
was starting to understand It, and so I told them, "Well, we're 
going to Hawaii, and how much Is our air fare?" and they said, 
"About fifteen hundred dollars,- so I said "Well, do you want to 
spend it on a computer Instead?" 

Dr. R - You asked them that? 

SI - I asked them, . . • . 

Dr. R - You prefer the computer to a trip to Hawaii? 

SI - Well, I've already been there once. I mean. If I used the 
computer, I'd be learning Spanish, and could get much better 
grades in my English and math classes, and I really like them 
[computers]. So they said, -Well, we'll get you one anyway. We 
can pay the bill, and still go to Hawaii, so... 

Dr. R - Fabuloso. 

51 - So, I'm going to get [a computer! ! 

Dr. R to Student 2 - How do you feel about this class, compared 
to your regular class? 

52 - It^s better... It's more interesting. 

Dr. R - What else do you like about it, or dislike about It. 
What are your other opinions? 

S.2 - It's fun. It's not as boring as regular class. 

Dr. R - In your other classes, do you concentrate this much? 

S2 - I suppose It depends, what you're doing. . .ummmm no, I 

guess not, 'cause your attention Isn't focused on just one 
thing. 

Dr. R - That's Interesting. 

Dr. R to Students - What did you think of the lesson? 

* Group comments, not distinguished by experimental versus 
control groups. 
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S3 - It was fun. 

Dr. R - Fun? What did you like about it? 
S3 - Everything, I guess. 

Dr. R - How does this compare to your classroom instruction? 

53 - Well, it's not as boring. 

Dr. R - Good. — [to Student 4] Well, you're used to working in 
a classroom, and now you're working on a computer, how do you 
like this? 

54 - It's f Ine. . . 

Dr. R - What do you think... Is this like a game, or is it 
different? 

S4 - No, it's good for learning.... 
Dr. R - Are you learning from this? 

S4 - Yeah, I guess. We've never had any of this kind of stuff.. 
Dr. R - How do you think you're doing on the tests? 
S4 - Doing okay. 

Dr. R - Are you getting them correct? 
S4 - Yeah. 

Dr. R - Well, great... How does this compare to your classroom 
experience? 

S4 - (Laughter) This ends quicker, so.-.. 
Dr. R • But you are learning? 

54 - Yeah, that's true. It 's a good Idea, I guess- 

Dr. R to Student 5 - How do you think this compares to your 
regular classroom Is It easier or more difficult to learn? 

55 - It's easier to learn, but it's easy anyway. 

Dr. R - So it seems easy to you In the classroom too? So 
Spanish Is just easy for you. How have you enjoyed this, working 
on the computer, as compared to your regular classroom? 

S5 - Well, sometimes It's fun and sometimes It's not. Because 

124 
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with this you can't 90 back and correct what you did wrong. 

Dr. R - You can't? 

S5 - Well, most of them, you can't. 

Dr. R - Do you try pressing this button? Before you press the 
Return button, you can go back and correct it. 

55 - No, but sometimes you have absolutely no Idea, and you have 
to choose a letter.... 

Dr. R Ohh (to S6) What did you like about it? 

56 -It's more challenging. 

Dr. R - More challenging! How does this compare to your class- 
room--how do you enjoy It? 

S6 -No teacher to tell you to stop doing things. 
Dr. R - Like what things? 

S6 - Like talking or chewing gum in class.... 

Dr. R - Does that affect your learning better, do you think? 

S6 - I'm not sure. 

Dr. R - Do you feel you concentrate well? 

56 - It lets you go your own speed, so you don't have to wait for 
other kids to read In the book and stuff like that.... 

Dr. R - You mean other people in the class? Well, that's terri- 
fic. 

Dr. R to Student 7 - How did you do? 

57 - Well, I messed up twice, but the pictures helped me,, when I 
didn't know the words. 

Dr. R - That's good. Do you find that you're learning with this? 

57 - Yeah. 

Jose to S 8 - How did you like It? 

58 - It was fun. 

Jose - What was fun about It? 
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S8 - I liked the last part, where you put things In order • You 
decided how to put it. They asked you what order the story came 
in. 

Jose - You thought that was fun? 
S8 - Yeah. 

Jose - Because it was funny, or...? 

S8 - Well/ sort of... I understood It — that was nice! 
Jose - You understood the story? 
S8 - Uh-huh- 

Jose - Was that better than yesterday? Where you had that real 
short one? 

S8 - Yeah. .yesterday I had trouble answering the questions. 
They asked questions, and you had to answer In complete senten- 
ces> and I had some problems with It.... 

Jose - So you did better today? 

58 - Yeah! 

Jose to Student 9 - What did you think of It today? 

59 - It was fun. 

Jose - What part was fun? 

39-1 didn't have really a favorite part. It was all fun. 
Jose - What WcS the story about? 
S9 - Two kids 

Dr. R to SIO - How did you do today? 
SIO - I only missed three. 

Dr. R - You only missed three, or got three right? 
SIO - I only missed three. 

Dr. S - You only missed three: That's fantastlco - muy bien! 
How do you think - are you learning more this way, or less this 
way, or the same? 

SIO - It's more fun than Just sitting in class and listening, but 
the drawback Is you can't take It home and study it If you want. 
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Dr. R - Well, suppose you could — would you want to? 
SIO - Sure. 

Dr. R - Do you have a computer at home? 
SIO - Uh huh. 

Dr. R - Good. Do you have an Apple? 
SIO - No, It's a Commodore 64. 

Dr. R - Suppose you could get Spanish materials like this to 
practice at home that went with your classroom things — would 
you like that? 

SIO - Yeah. . . 

Dr. R - And you'd really do that at home? Would you like doing 
it better than written homework? 

510 - Yeah. 

Dr. R - Okay! That sounds terrific 

Jose to 31 1 (Boy) — How did you do? 

511 - Oh, it was pretty good. 

Dr.R - Well, did you enjoy it? What did you like about it? 

Sll - I don't know got to pick who I was going to hear 

about .... 

Dr. R - Oh, you liked being able to pick who did you pick that 
you'd 1 ike to be? 

Sll - Forgot. 

Dr. R - Well, who would you like to be? If you could be anybody 
that you wanted to be.... 

Sll - Well, I don't think that I 

Dr. R - ...How do you like learning this way? Do you feel you're 
learning? 

Sll - Yes. 

Dr. R - How does this compare to your regular classroom? 

Sll - It's a little easier, 'cause you don't have a teacher to 
yell at you. 
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Dr, R (Laughter) What would you do If the computer yelled at you? 
SU - I'd throw it down on the ground. 

Dr. R - (Laughter...) Well, the computer's never going to yell at 
you! ...Does the little "beep" bother you? 

SU - No, I like that! 

Dr. R to S12 - .... (In m Id-conversat Ion) Why do you think you 
learn more on the computer? 

S12 (girl) - (Unintelligible) ... and It's not organized like a 
teacher . 

Dr. R - Is there anything particular that you like about working 
with a computer — like about this lesson today? 

S 12 - I don't know — I guess because you learn new words, and 
get to put them Into the computer and stuff.. 

Dr. R - Do you think you*re actually learning, or is it like 
playing? 

S12 - I'm learning! 

Dr. R - How are you doing when it comes to the test part? 
S12 - Okay. 

Dr. R - Are you getting most of them correct? 

512 - Yeah. 

Dr. R - Great. Thanks! 

Dr. R to S13 (Boy) - Do you think this is a good way to learn? 

513 - Yeah. 
Dr. R - Why? 

S 13 - ....Because a lot more attention's paid to you . Youfre -not 
ignored . 

Dr. R - What do you mean "ignored"? 

S13 - Well, sometimes In class you can't get to the teacher all 
the time. This way you can. 

Dr. R - What do you mean? What do you -get to" If you don't 
understand here? What do you do? 

S13 - Well, this way you're sitting right in front of the 
teacher . 

Dr. R - I see, so you get to concentrate 
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II, Group discussion In the classroom with another class before 
computer instruct Ion . — — -~ 

Dr. R (to student group) - How do you feel about learning on the 
computer? 

Student A - Well, It's not any easier, but It's not any harder, 
than just being In the classroom. 

Student B - It's more enjoyable than sitting In the classroom! 
You get to sit there and just do everything you want Instead of 
doing it as a class. You have your own computer - It's like your 
own personal little class.... 

Dr. R - And you like that? 

Student B - Yeah. 

Student B - It's a lot easier. 

Dr. R - Because you're able to concentrate more? 
Student B - Uh huh. 

(Several students verbally agree ) 

Student C - I like being able to work at my own pace. When you 
have a computer, you can take time to figure things out. 

Dr. R - What happens in class? Why can't you go at your own 
pace? 

Student D - Well, you can, but you get lost. You get left behind. 
Student E - Well, you are at a disadvantage if you can't type. 
(General laughter) ^ 

Dr. R - Is working with the computer helping you feel more 
comfortable with the typing, and with working on a computer In 
general? ^ 

(General assent.) 

Student F - Well, If you had computers in all your classes - 
math, English, It wouldn't be as fun, because the novelty 
wouldn't be there. 

Dr. R - So you think It's fun because It's novel, new? 

Student F - Yeah! And It would also get kind of boring to just 
sit there typing, staring at the screen hour after hour. 

Student G - I was going to say, that If we just had computers at 
school like that, then we could just do the same thing at home! 
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Dr. R - What If you could do homework at home on the computer. 
Instead of writing things regularly? 

S. B (girl) - rather come to class and have a teacher and be 
able to discuss things, rather than sit there typing onto 
something that can't really think... a different set of opinions. 

Dr. R - So you'd like to have the human element. I think that's 
real Important. 

S H - Well, it wouldn't be too good to take homework home and do 
it on the computer all the time, because suppose you've got to 
fill out a job application, and you had to hand write it in an 
office or something, and you would be used to working on a 
computer, and 

Dr. R - Good point. Any more comments 

S. I - Also, you don't get the specialized comments that you 
would with a teacher ...it's just a programmed thing... • 
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III. Interview in the Principal's office with Mr. Welsh 

Dr. R Here we are with Mr. Welsh, Principal of Montera Junior 
High School. ...I think what we would most like to know, is why 
you've been interested in having this study here? 

Welsh - Well, we've been delighted to participate in this study, 
and there are really three reasons why we were initially in- 
terested, and each of these reasons has been reinforced from what 
I've seen in terms of response students have given in the 
classroom to the program. 

The first is, we have been actively working on introducing the 
computer into the academic program here at the school, with an 
emphasis on computer-assisted instruction. This particular 
program allows the teacher a model of how they can begin to 
incorporate the microcomputer into the teaching of their particu- 
lar curriculum. One feature I like about it is that the 
programs were designed around what Is currently being taught in 
the classroom by the teachers. 

The second reason is that we have been promoting foreign 

languages here for the last five years, and anything in the area 

that would continue to lend support to that, such as your 
program. Is welcome. 

And last, but not least, I think the more exposure we give 
youngsters as wel 1 as staff to the variety of uses that a m icro- 
computer can serve, the better prepared we're going to be - - the 
better prepared our students are going to be for the future, and 
seeing this as a tool, that can be adapted to a variety of 
situations throughout their lives. I think the program shows 
them that there is nothing foreign between teaching a foreign 
language and using a microcomputer. It doesn't have to be a 
video game, it doesn't have to be something that deals only with 
mathematics, that it can incorporate not only foreign languages 
in it, but also the English literature, science, history, and the 
whole realm of academic programs offered throughout an educa- 
t ional i nst i tut i on . 

We're pleased! 

Dr. R - We're certainly pleased to be here. Our staff observa- 
tions confirm this is having an effect on the students' use of 
computers per se in a more serious vein. When the students began 
the study, we noticed they were just pressing "Return^ and just 
trying to get through the program, almost like playing ""Pac Man", 
to see how many screens they could get through. This was on the 
very first day. Then we explained to them, the object of this is 
to learn, and not to get through as many screens as possible, and 
this is why we have the testing each day. So they are learning 
that they can learn from the computer. 

(Further comments on tape regarding future Intentions of study, 
etc. ) 
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Welsh - Some observations after visiting the lab with the i 
students in there, was that I was impressed with the intensity 
and the amount of time on task that the youngsters were demon- 
strating with their behaviour. The second thing that struck me j 
was the motivational level that the students were demonstrating 
by staying on task* It was a heterogeneous group of youngsters, 
and being familiar with some of them, I was really impressed with 4 
the intensity they were bringing to this particular project. I 
would hope they would generalize that and transfer that to their 
other academic courses* 

The third thing that impressed me, in talking briefly with a 
couple of students, is they thought they were doing something d 
very important. Not necessarily with the project, but the fact 
that they were actually and effectively manipulating a microcom- 
puter in a foreign language. They felt that they were achieving, 
and the whole aura that this sets for the youngsters, the results 
are going to be very positive about the study. I think that it 
sets a tone that is going to pay off in some real learning | 
results for you . 
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IV, Carollyn Rudeslll Interviewing Wilga Rivers at our Mills 
office after attending the morning computer classes. 

CSR - How do you think the project went today? 

WR - Well, I vas very excited to see the students actually 
working with the computers, and to see the intensity of Interest 
the students were showing, and the way In which they seemed to be 
concentrating, especially for junior high school students. 

CR - Yes, they did. 

WR - And they seemed to be enjoying what they were doing. They 
seemed to be working at It quite Intelligently, referring back 
when they needed to, to review the program, and not just sitting 
there wondering what to do next. So they clearly had learned 
how to handle the machines very quickly. I'm hopeful that the 
results will show some interesting differences In the particular 
hypotheses that are being tested. 

CR - What are the hypotheses that you and Dr. Robinson developed 
In doing this project. 

MR - Well, It was Dr. Robinson that did the Initial thinking out 
of the hypotheses, of course. We refined then together. And the 
aim Is to try to see whether certain techniques developing from 
certain methodological approaches are more effective than 
others. We read a lot of literature about the fact that students 
learn a lot better by one approach rather than another, but as 
often as not. It is the enthusiasm of the promoter of a particu- 
lar approach that Is being rather over-stated rather than 
actually having factual Information about how the students 
are learning. So this kind of project, although it Is at the 
moment on a computer, can be extrapolated too, to classroom 
exercises using a textbook, I should think, because if we can 
find that there Is very little difference between the results 
from one technique and another, then we can choose whichever Is 
the most efficient from the point of view of best use of time, 
what the teacher can best do In particular circumstances, so that 
the study should then be able to give you a guide, give, guide- 
lines for materials, product Ion, textbook production, and 
certainly, most certainly, for computer assisted programs which 
are being produced by the textbook companies to accompany 
textbook materials. And so, Instead of just following along the 
lines of certain time-honored, easily programmed types of 
exercizes, we will have a lot more variety to offer to the 
students who are trying to learn with the programs, because they 
can't go on forever just filling in the blanks, and doing 
multiple choice. They get very bored with that. Especially as 
the computer age comes along, and they're doing the same thing In 
science that they're doing In history. There is a limit to the 
amount that a child during a day can do of exactly the same type 
of activity. ^ 
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CR - I can see how that specifically relates to the computer 
work. But you said you also feel that these results may have 
an impact on classroom techniques, etc.... 

WR - Yes. Because if you find out that certain techniques are 
equally efficient with others, then you have to look much more at 
purely motivational angles. If they do produce similar results, 
which ones are most motivating, and also which ones are most 
possible for the average teacher to Implement, because we have to 
work with the average teacher, not just the brilliant teacher who 
goes off to all the meetings, and knows exactly what's going on. 
We have to have the types of approaches that the average teacher 
with an average sort of training can use effectively. 

CR - Very interesting. I would also like to ask about what you 
might see as the national or International Impact of this study. 
Do you see It having a far-reaching effect on computer techno- 
logy? 

WR - Well, it's like all of these studies. It will have a 
far-reaching effect if the results are sufficiently published by 
It. And so of course, as soon as the project Is over and the 
results have come out, apart from the official report which goes 
in the public domain, which will be available. It is actually 
essential that the members of the Center then write articles In 
different journals, explaining to different populations, the 
Indications of the study. And presumably, following up In the 
second stage implications of these types of conclusions for 
production of materials, 

CR - What did you think of the specific lesson that you saw this 
morning? Pros or cons, in terms of how It was run and the way 
students were Interacting with their environment? 

WR - Well, I think the inclusion of the graphics was definitely a 
plus. You see so many of these programs that are just dull 
printing. And in the same age, when we talk about students 
having trouble with just print media for learning. I think the 
graphic Is very, very Important, and certainly It was eye- 
catching and the sketches were clean. In the sense that -the 
outlines were clear. They weren't cluttered. So It was quite 
obvious to the student what they were supposed to be working 
out. And In the problem-solving element, they had to think for 
themselves, rather than just check off something that was 
provided. This Is, of course, important. 

CR - So Ijt was pretty well thought through in terms of how It 
was dealing with the subject at hand. 

WR - Yes. 

CR - Is there anything else you would like to say about the 
project as a whole? 
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WR - I think that the point that you made this morning, and 
which has been nade before, that teachers have to look upon the 
new media, the computer and the video disk and so on, as being 
things that can help improve their teaching, help them to be 
better teachers, I should say, more effective teachers, to reach 
their students, to enable their students to learn more effec- 
tively. I think that teachers don't have to be afraid that this 
Is going to take away their jobs. At the time the language labs 
cane In, that was the same fear with the teachers — that 
technology would do their job for them. In language learning 
particularly, this will never* be so, because language learning Is 
communication and Interaction, and you can't have real communica- 
tion and Interaction except with another thinking being, and this 
whole communication where what one Is to respond Is triggered by 
a smile or a look or by a look of Incomprehension and so on, and 
all of this Is part of communication. And all of this has to 
come la the classroom interaction with the teacher and student* 
student and student. And the work with the computer, I think 
will be Important in that a great deal of the more tedious aspect 
of language learning, that has to at some stage be mastered: 
knowledge of vocabulary, knowledge of grammatical and syntactic 
features — these things can be done In an Interesting way with 
the computer, and the student who needs to, can spend much longer 
on It, whereas the student who doesn't, doesn't have to be 
wearied by waiting for the others to catch up. So then the 
classroom can be used for the much more interesting and exciting 
Interactive activities. So I see them as a way of Improving 
language teaching, and enabling the teacher to do In the class- 
room the things that onl^ a teacher can do. 

CR.- - That's excellent. That really puts the computer In a 
support function for the teacher. 

WR - Yes. And for the student. 



Cr - That's right. 



WR - Because the computer, by Its nature. Is very patient, in the 
sense that It Is willing to repeat over and over again and to 
shoe the same diagram, to show the same chart, without ever 
giving the student any sense of embarrassment at having to ask It 
a tenth time! And so this enables us to realize the dream of the 
seventies — to have more Individualized Instruction, more 
personalized Instruction. And as one has more experience In 
programming, and as one becomes more innovative and daring In 
programming, we'll be able to give Individual students much more 
the types of exercises to work with, which they themselves enjoy, 
that they even perhaps will be able eventually to create some of 
their own as time goes on. 

CR - Great! Well, this project Is certainly a start In that 
direction . 
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WR - I think so. And I think one only had to see those students 
working this morning to realize that they were enjoying what they 
were doing, and that Is the first step towards solving any 
educational problem, Is to have students enjoying what they are 
doing. Really enjoying, and Involving themselves In It. 

CR - Yes, I think one of the telling features In that was to see 
how many of the students chose to repeat the esrerclse a second 
time, although It wasn't at aTT"*requ Ired. 

WR - Quite, quite. 

CR - They were Intrigued enough by the activity to want to go 
through It again, which Is nice for a teacher to see. 

WR - This is Important, because this Is what we would always 
hope they would want to do with their own homework, but It Isn't 
always so- 

CR - No, that's a unique aspect for a teacher to see a student 
asking to repeat work! 
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APPENDIX H 



The source codes were wrlttea In the C progra»»lng language, 
r-?.nd were compiled and linked Into executable programs using the 
Aztec C system for the Apple II > version 1,05 (copyright Manx 
Software Systems, 1984) • 

Each of the ten dally sections corresponding to each day, 
contains several Independent files that were compiled separately 
and then linked together to form one program. Within the 
sections, two flies always appear, titled •text.c" and 
"display .c". The C source contained in these two flies was 
written by Richard Basse In for the software package -Juegos 
Communlcativos (Communicative Games)-, published by Random 
House • This source Includes most of the Initial graphics 
functions and Spanish character generation functions* In some 
of the sections, the source In "text^c" and 'display. c* was very 
slightly modified by the Principal Programmer, or unused portions 
deleted. la addition to the functions In "dlsplay.c- and 
"text^c", the "Juegos" source codes provided a memory allocation 
scheme and useful structure in which to develop the project 
software. The Center Is grateful to Richard Basse in and John 
Usiderwood, co-author, for pernlsslon In using this source for 
research purposes. 

Although, except as where noted, the source codes are entirely 
original, some of the Ideas used In the design and appearance of 
the final product had Inspiration In other software packages 
dealing with CAI In foreign language. These are listed below: 

SiaSS^Masterj. Christopher Jones 

5§Sheri ^S^^S§ii§E«PEOcessor_for_Language_Stu^ Jawes P. Pusack 

DE:iiiShell, Conduit Educational Software 
Juegos^CommunicaUy^^ Richard Basse In and John Underwood 



PROGRAMMING STAFF: 

Lisa Borden, Principal Programmer 
Mary Ivanetlch, Assistant Programmer, 
Richard Basse In, Programming Consultant 
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